-- Logs begin at Thu 2022-08-18 19:38:44 UTC, end at Thu 2022-08-18 21:05:01 UTC. -- Aug 18 20:33:06.026852 dv-cinder-852654-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 20:33:06.034322 dv-cinder-852654-2-smb devstack@keystone.service[88337]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 20:33:06 2022] *** Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: nodename: dv-cinder-852654-2-smb Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: machine: x86_64 Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: clock source: unix Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: pcre jit disabled Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: detected number of CPU cores: 4 Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: current working directory: / Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: detected binary path: /usr/bin/uwsgi-core Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: your processes number limit is 47680 Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: your memory page size is 4096 bytes Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: detected max file descriptor number: 2048 Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: lock engine: pthread robust mutexes Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: thunder lock: enabled Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 20:33:06.038809 dv-cinder-852654-2-smb devstack@keystone.service[88337]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 20:33:06.077852 dv-cinder-852654-2-smb devstack@keystone.service[88337]: Python main interpreter initialized at 0x55acee0019c0 Aug 18 20:33:06.077852 dv-cinder-852654-2-smb devstack@keystone.service[88337]: python threads support enabled Aug 18 20:33:06.077852 dv-cinder-852654-2-smb devstack@keystone.service[88337]: your server socket listen backlog is limited to 100 connections Aug 18 20:33:06.077852 dv-cinder-852654-2-smb devstack@keystone.service[88337]: your mercy for graceful operations on workers is 90 seconds Aug 18 20:33:06.078269 dv-cinder-852654-2-smb devstack@keystone.service[88337]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 20:33:06.078269 dv-cinder-852654-2-smb devstack@keystone.service[88337]: *** Operational MODE: preforking *** Aug 18 20:33:06.078546 dv-cinder-852654-2-smb devstack@keystone.service[88337]: *** uWSGI is running in multiple interpreter mode *** Aug 18 20:33:06.078546 dv-cinder-852654-2-smb devstack@keystone.service[88337]: spawned uWSGI master process (pid: 88337) Aug 18 20:33:06.078755 dv-cinder-852654-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 18 20:33:06.081083 dv-cinder-852654-2-smb devstack@keystone.service[88337]: spawned uWSGI worker 1 (pid: 88345, cores: 1) Aug 18 20:33:06.081083 dv-cinder-852654-2-smb devstack@keystone.service[88337]: spawned uWSGI worker 2 (pid: 88346, cores: 1) Aug 18 20:33:06.081083 dv-cinder-852654-2-smb devstack@keystone.service[88337]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 20:33:10.412628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:33:10.412628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: from cryptography.utils import int_from_bytes Aug 18 20:33:10.413422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:33:10.413422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: from cryptography.utils import int_from_bytes Aug 18 20:33:10.413854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:33:10.413854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: from cryptography.utils import int_from_bytes Aug 18 20:33:10.413964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:33:10.413964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: from cryptography.utils import int_from_bytes Aug 18 20:33:10.466567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:33:10.466795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:33:10.466953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] command line args: [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:33:10.467225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:33:10.467404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ================================================================================ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:33:10.467660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] admin_token = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.467906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] config_dir = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.468093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.468272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] config_source = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.468453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] debug = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.468652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.469153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.469252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.469444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.469691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.469920 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.470100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] log_config_append = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.470278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.470454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] log_dir = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.470630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] log_file = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.470884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.471135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.471397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.471632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.471808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.471990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.472220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.472466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.472696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.472941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.473154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.473384 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.473634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.473913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.474155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.474639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.474844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] publish_errors = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.475057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.475286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.475472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.475718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.475950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.476161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] standard_threads = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.476391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.476633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.477451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.477669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] use_journal = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.477792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] use_json = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.477952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] use_stderr = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.478209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] use_syslog = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.478339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.478597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.478859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.479156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.479512 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.479771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.480010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.480260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.480497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.480747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.480996 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.481247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.481479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.481726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.481963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:33:10.482101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.482225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.482342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:33:10.482458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.482582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] command line args: [] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:33:10.482699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.482932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.483063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:33:10.483181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.483304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ================================================================================ {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:33:10.483420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.483575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] admin_token = **** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.483701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.483890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.484016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] config_dir = [] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.484143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.484274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.484399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.484516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] config_source = [] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.484637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.484765 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] debug = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.484884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.485047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.485200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.485318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.485444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.485561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.485676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.485797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.485968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.486087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.486260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.486415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.486535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.486651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.486791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] list_limit = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.486910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.487073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] log_config_append = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.487195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.487346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.487467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.487589 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.487712 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] log_dir = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.487830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.487946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] log_file = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.488069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.488225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.488346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.488470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.488610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.488730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.488892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.489012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.489130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.489363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.489482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.489602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.489724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.489841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.489962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.490088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.490250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.490367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.490484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.490648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.490787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.490959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.491079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.491196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.491398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.491524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.491674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.491850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.491978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.492210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.492363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.492587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.492789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.492908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.493030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.493250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.493415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.493543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.493720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.493982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.494174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.494297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.494440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.494568 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] publish_errors = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.494687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.494833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.494963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.495177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.495296 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.495423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.495541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.495660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.495830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.495956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.496103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.496231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.496386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.496547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] standard_threads = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.496668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.496864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.496985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.497109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.497267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.497387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.497505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] use_journal = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.497620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.497747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] use_json = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.497864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] use_stderr = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.497978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.498094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] use_syslog = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.498268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.498388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:33:10.498582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.498701 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.498842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.498982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.499100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.499227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.499469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.499589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.499712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.499830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.499952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.500163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.500293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.500417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.500542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.500660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.500940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.501077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.501203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.501320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.501435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.501550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.501692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.501837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.501965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.502190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.502316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.502467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.502572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.502799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.502923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.503081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.503186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.503327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.503552 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.503694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.503878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.504058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.504231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.504405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.504580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.504580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.external = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.504922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.505078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.505078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.505409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.505555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.505766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.505928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.password = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.505928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.token = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.506285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.506460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.506460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.506799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.506799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.507128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.507311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.507485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.507658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.507833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.508530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.508717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.508717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.509079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.509322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.509322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.509552 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.509706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.509834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.509952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.509952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.510174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.510297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.510449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.510569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.510569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.510803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.510933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.511053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.511179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.511179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.511414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.511532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.511648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.511648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.511905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.512025 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.512144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.512260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.512377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.512498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.512624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.512742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.512859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.512859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.513078 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.513204 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.513330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.513448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.513565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.513680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.513796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.513989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.514121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.514241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.514391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.514534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.514703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.514978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.515109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.515240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.515359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.515476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.515591 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.515708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.515862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.515992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.516110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.516232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.516352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.516548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.516678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.516805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.516931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.517049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.517166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.517283 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.517401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.517530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.517648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.517765 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.517881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.518004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.518148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.518276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.518395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.518523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.518642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.518759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.518910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.519030 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.519148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.519274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.519394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.519394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.519625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.519756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.519876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.520002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.520128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.520246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.520364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.520481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.520600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.520726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.520844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.520844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.521072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.521197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.521315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.521442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.521561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.521687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.521805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.521923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.522041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.522167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.522285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.522410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.522528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.522647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.522803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.522938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.523058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.523058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.523278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.523396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.523513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.524207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.524462 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.524589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.524708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.524826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.524944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.524944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.525177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.525296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.525414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.525541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.525661 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.525789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.525909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.526027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.526145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.526263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.526380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.526507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.526627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.526753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.526919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.527050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.527182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.527302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.527421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.527539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.527656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.527774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.527955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.528077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.528195 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.528314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.528431 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.528549 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.528675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.528795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.528913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.529032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.529149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.529274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.529467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.529590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.529708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.529826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.529943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.530062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.530188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.530308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.530425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.530544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.530661 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] auth.external = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.530837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.530971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.531092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.531092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.531314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.531433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.531550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.531676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.531795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] auth.password = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.531913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.532031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] auth.token = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.532031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.532253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.532379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.532497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.532497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.532718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.532836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.532953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.533079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.533199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.533317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.533434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.533552 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.533669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.533794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.533913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] credential.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.534037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.534156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.534274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.534391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.534517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.534636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.534753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.534891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.535020 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.535140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.535267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.535386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.535504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.535621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.535738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.535855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.535981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.536100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.536217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.536335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.536453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.536570 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.536699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.536818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.536934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.537050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.537166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.537281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.537406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.537525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.537641 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.537756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] federation.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.537872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.537987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.538112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.538230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.538346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.538462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.538578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.538694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.538862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.538982 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.539099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.539333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.539456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.539456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.539687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.539804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] role.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.539920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.540035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] role.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.540152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.540277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.540395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.540513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.540649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.540649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.540878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.541005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.541124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.541242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.541242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.541463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.541589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.541716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.541835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.541953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.542070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.542188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.542311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.542438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.542548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.542665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.542796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.542915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.543033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.543161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.543281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.543399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.543516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.543635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.543753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.543753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.543984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.544101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.544226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.544345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.544468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.544596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.544716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.544716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.544936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.545054 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.545171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.545297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.545416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.545416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.545637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.545754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.545872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.546003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.546123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.546240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.546358 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.546475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.546604 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.546722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.546882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.547000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.547117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.547232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.547361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.547479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.547595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.547711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.547828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.547945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.548069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.548069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.548288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.548404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] token.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.548520 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.548636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.548761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.548880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.548995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.549111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.549227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.549227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.549453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.549571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.549687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.549802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.549919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.550035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.550162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.550281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.550397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.550513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.550630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.550746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.550892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.551013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.551130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.551247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.551365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.551482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.551607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.551726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.551843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.551843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.552064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.552182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.552370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.552370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.552594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.552711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.552828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.552954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.553083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.553083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.553315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.553434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.553551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.553668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.553786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.553912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.554031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.554156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.554275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.554393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.554510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.554635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.554753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.555362 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.555481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.555594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.555703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.555812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.555914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556013 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.556854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:33:10.557341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.557341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.558148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.558148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.558148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.558148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.558506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.558603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.558836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.559087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.559355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.559591 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.559830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.560072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] resource.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.560327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.560577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.560813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.561066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.561317 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.561560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.561811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.562048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.562288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.562528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] role.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.562786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] role.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.563029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.563279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.563531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.563782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.564035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.564279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.564526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.564774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.565023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.565256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.565511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.565753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.566000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.566246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.566670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.566935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.567192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.567444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.567696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.567946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.568180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.568434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.568687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.568926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.569159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.569392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.569625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.569876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.570133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.570379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.571247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.571527 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.571767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.572198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] token.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.572443 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.572770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.573070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.573369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.573623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.573879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.574126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.574370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.574621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.574891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.575132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.575369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.575619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.575869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.576102 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.576343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.576638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.576902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.connection = **** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.577149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.577401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.577639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.577881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.578120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.578358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.578594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.578854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.579103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.579340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.579584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.579820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.580071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.580307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.580552 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.580786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.581027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.581265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:33:10.581442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:33:10.585062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.585295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.585523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.594878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.606699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.606960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.607191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.615534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.622856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.623088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.634071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.634298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.677596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.678989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.727282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.727458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.727540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.727642 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.892236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.892466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.892676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.892893 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.893110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.893324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.893487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.893725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.893947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.894166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.894385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.894601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.917340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.917613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.917754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.917854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.917936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.918011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.918088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.918170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.918254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.918373 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.918454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.918583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.918664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.918813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.929672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.929959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.942571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.942703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.942817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.942914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.943989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:33:10.960691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.960901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:33:10.960984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.961821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:33:10.961902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.962106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:33:10.962319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.962400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.962636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:33:10.962720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.962926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.963008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.963184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.963273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.963700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.963965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.972876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.973157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.973365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.973448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.973645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.973739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.973917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.974201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.980798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:10.981413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:10.983737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:10.984031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.984320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.984400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:10.984606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.984688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.984887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.984971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.985151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.985231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.985426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.985516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.985685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.985763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.985956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.986035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.986228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.986308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.986497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.986607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.986912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:10.987186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.010200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.010758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.011701 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.011990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.012256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.012542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.016702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.016984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.017243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.017331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.017530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.017814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.024216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.024658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.024746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.025138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.028609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.028903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.029158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.029245 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.029450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.029549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.029732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.029814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.030011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.030093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.030286 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.030369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.030558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.030638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.030856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.031125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.048016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.048309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.048541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.048828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.052212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.052728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.056175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.056472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.056557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.056777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.060716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.061012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.063900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.064271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.067176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.067485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.067570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.067776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.067860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.068064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.068158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.068346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.068429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.068623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.068706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.068911 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.084956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.085244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.085338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.085517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.085603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.085795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.085881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.086600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.093364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.093528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.094923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.095085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.095213 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.095361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.097860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.098000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.098153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.098287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.098448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.098533 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.098737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.098852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.099054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.099138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.110457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.110559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.110747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.110859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.111053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.111138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.111332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.111423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.111611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.111696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.111886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.111970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.112164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.112249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.128072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.128308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.131121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.131387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.134404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.134733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.135885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.136205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.137352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.137636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.137719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.137938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.138023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.138250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.144458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.144776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.145917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.146536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.149403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.149699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.149792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.149991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.150076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.150267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.150377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.150701 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.158253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.158545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.158746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.158849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.159066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.159350 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.165847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.166131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.166309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:33:11.166407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.166598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.166694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.166902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.167004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.167185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.167278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.167481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.167577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.167739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.167821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.168008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.168092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.168283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.168363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.168565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.168658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.168827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.168918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.169099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.169227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.169357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.169439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.169630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.169894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:33:11.203939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55acee0019c0 pid: 88346 (default app) Aug 18 20:33:11.204656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55acee0019c0 pid: 88345 (default app) Aug 18 20:33:11.207331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4674d-c805-4d10-855a-461539d4892f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:11.207616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4674d-c805-4d10-855a-461539d4892f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:11.207885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4674d-c805-4d10-855a-461539d4892f None None] PATH_INFO: `/v3` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:11.212802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Thu Aug 18 20:33:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:17.813992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaefdf-a8cc-4b56-8782-9665cec37be6 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:17.814530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaefdf-a8cc-4b56-8782-9665cec37be6 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:17.814530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaefdf-a8cc-4b56-8782-9665cec37be6 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:17.818812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:17.824861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:17.825290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:17.825407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:17.895937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: INFO dbcounter [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] Registered counter for database keystone Aug 18 20:33:17.915439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG oslo_db.sqlalchemy.engines [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:33:17.924051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writer thread running {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:33:18.110914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG passlib.handlers.bcrypt [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88346) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 20:33:18.111335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG passlib.handlers.bcrypt [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88346) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 20:33:18.166894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:18.168433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:18.297851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 20:33:18.781357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaefdf-a8cc-4b56-8782-9665cec37be6 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:18.852446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: INFO dbcounter [None req-29eaefdf-a8cc-4b56-8782-9665cec37be6 None None] Registered counter for database keystone Aug 18 20:33:18.874636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG oslo_db.sqlalchemy.engines [None req-29eaefdf-a8cc-4b56-8782-9665cec37be6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:33:18.880923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writer thread running {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:33:19.006074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaefdf-a8cc-4b56-8782-9665cec37be6 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:19.010678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9824e-067f-4917-9c6c-bff65c7732ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:19.011335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9824e-067f-4917-9c6c-bff65c7732ff admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.011616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9824e-067f-4917-9c6c-bff65c7732ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.011889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9824e-067f-4917-9c6c-bff65c7732ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:19.020108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9824e-067f-4917-9c6c-bff65c7732ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:19.071921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ccc9824e-067f-4917-9c6c-bff65c7732ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 20:33:19.072265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9824e-067f-4917-9c6c-bff65c7732ff admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:19.082333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Aug 18 20:33:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 20:33:19.088402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:19.103917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700567c-ba59-455b-9c24-ddcd184c61a7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:19.108323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a4acd-6822-415e-8af9-0b5954c32d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:19.109447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a4acd-6822-415e-8af9-0b5954c32d95 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.109733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a4acd-6822-415e-8af9-0b5954c32d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.110021 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a4acd-6822-415e-8af9-0b5954c32d95 admin admin] PATH_INFO: `/v3/projects/0469791b573f4534aad86764e4849307` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:19.111620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a4acd-6822-415e-8af9-0b5954c32d95 admin admin] RBAC: Authorizing `identity:get_project(project_id=0469791b573f4534aad86764e4849307)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:19.165895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WARNING keystone.common.rbac_enforcer.enforcer [None req-394a4acd-6822-415e-8af9-0b5954c32d95 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 20:33:19.166246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a4acd-6822-415e-8af9-0b5954c32d95 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:19.170829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Aug 18 20:33:19 2022] GET /identity/v3/projects/0469791b573f4534aad86764e4849307 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:21.103106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895568e5-029e-4159-b5f0-22fe9ba60713 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.103967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895568e5-029e-4159-b5f0-22fe9ba60713 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.103967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895568e5-029e-4159-b5f0-22fe9ba60713 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.111033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:21.118593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f06b-960f-4c57-a5a5-9bb8727d5b8e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.119231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f06b-960f-4c57-a5a5-9bb8727d5b8e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.119231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f06b-960f-4c57-a5a5-9bb8727d5b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.142994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8298f06b-960f-4c57-a5a5-9bb8727d5b8e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:21.144546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8298f06b-960f-4c57-a5a5-9bb8727d5b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:21.153241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 20:33:21.450697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895568e5-029e-4159-b5f0-22fe9ba60713 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.464420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895568e5-029e-4159-b5f0-22fe9ba60713 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.468696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b875ad-726a-402a-b12b-92cbb9da1e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.469309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b875ad-726a-402a-b12b-92cbb9da1e04 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.469590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b875ad-726a-402a-b12b-92cbb9da1e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.469864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b875ad-726a-402a-b12b-92cbb9da1e04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.479040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b875ad-726a-402a-b12b-92cbb9da1e04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:21.480869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b875ad-726a-402a-b12b-92cbb9da1e04 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:21.491669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:33:21.497876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298f06b-960f-4c57-a5a5-9bb8727d5b8e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.507658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298f06b-960f-4c57-a5a5-9bb8727d5b8e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.513024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785dc8a-9fa8-43b5-89e2-fb5aeb4a1670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.513653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785dc8a-9fa8-43b5-89e2-fb5aeb4a1670 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.513931 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785dc8a-9fa8-43b5-89e2-fb5aeb4a1670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.514201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785dc8a-9fa8-43b5-89e2-fb5aeb4a1670 admin admin] PATH_INFO: `/v3/users/046ce058984843509c9c689fc1b1fe83` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.515630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785dc8a-9fa8-43b5-89e2-fb5aeb4a1670 admin admin] RBAC: Authorizing `identity:get_user(user_id=046ce058984843509c9c689fc1b1fe83)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:21.517700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785dc8a-9fa8-43b5-89e2-fb5aeb4a1670 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:21.519359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/users/046ce058984843509c9c689fc1b1fe83 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:23.547395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b40563-e03f-45e5-9c62-a95155d10441 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.547932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b40563-e03f-45e5-9c62-a95155d10441 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.547932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b40563-e03f-45e5-9c62-a95155d10441 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.549265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:23.554259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d150e-84c8-421e-90c2-8b64975d28bb None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.554689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d150e-84c8-421e-90c2-8b64975d28bb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.554975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d150e-84c8-421e-90c2-8b64975d28bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.573672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ae7d150e-84c8-421e-90c2-8b64975d28bb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:23.574909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ae7d150e-84c8-421e-90c2-8b64975d28bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:23.594732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bffd4-0f0b-43a7-9473-bafc8cf68784 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.595059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bffd4-0f0b-43a7-9473-bafc8cf68784 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.595339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bffd4-0f0b-43a7-9473-bafc8cf68784 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.596684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:23.602664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792569d-c112-402c-a041-7acc1b9d4998 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.602978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792569d-c112-402c-a041-7acc1b9d4998 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.603260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792569d-c112-402c-a041-7acc1b9d4998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.647176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG passlib.handlers.bcrypt [None req-b792569d-c112-402c-a041-7acc1b9d4998 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88345) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 20:33:23.647593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG passlib.handlers.bcrypt [None req-b792569d-c112-402c-a041-7acc1b9d4998 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88345) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 20:33:23.657108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:23.693991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b792569d-c112-402c-a041-7acc1b9d4998 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:23.696716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b792569d-c112-402c-a041-7acc1b9d4998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:23.798030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:23.920868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d150e-84c8-421e-90c2-8b64975d28bb None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:23.946050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:24.033141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d150e-84c8-421e-90c2-8b64975d28bb None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:24.067572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792569d-c112-402c-a041-7acc1b9d4998 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:24.068809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3a348-760e-4369-8372-b2a4f28eaddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:24.069458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3a348-760e-4369-8372-b2a4f28eaddc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.069742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3a348-760e-4369-8372-b2a4f28eaddc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.070014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3a348-760e-4369-8372-b2a4f28eaddc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.081776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3a348-760e-4369-8372-b2a4f28eaddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-65f3a348-760e-4369-8372-b2a4f28eaddc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:24.090575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:24.091862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:24.092778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:24.097750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3a348-760e-4369-8372-b2a4f28eaddc None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:24.173652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792569d-c112-402c-a041-7acc1b9d4998 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:24.175939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:24.182003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:24.201815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3a348-760e-4369-8372-b2a4f28eaddc None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:24.212807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c98f0-84db-4b81-ae93-df4107e8f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:24.213700 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c98f0-84db-4b81-ae93-df4107e8f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.213982 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c98f0-84db-4b81-ae93-df4107e8f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.214253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c98f0-84db-4b81-ae93-df4107e8f1a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.235812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cde8-3509-437e-8220-4fdf3082b504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:24.236430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cde8-3509-437e-8220-4fdf3082b504 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.236714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cde8-3509-437e-8220-4fdf3082b504 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.236990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cde8-3509-437e-8220-4fdf3082b504 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.237666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159cde8-3509-437e-8220-4fdf3082b504 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:24.237971 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159cde8-3509-437e-8220-4fdf3082b504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:24.239425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159cde8-3509-437e-8220-4fdf3082b504 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:24.251270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:24.256888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cde8-3509-437e-8220-4fdf3082b504 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:24.284915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c98f0-84db-4b81-ae93-df4107e8f1a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:24.286437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c98f0-84db-4b81-ae93-df4107e8f1a0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:24.356712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cde8-3509-437e-8220-4fdf3082b504 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:24.389405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:33:24.393390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac3f40-9ed5-46e6-acd3-29da032ea91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:24.394127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac3f40-9ed5-46e6-acd3-29da032ea91d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.394416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac3f40-9ed5-46e6-acd3-29da032ea91d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.394693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac3f40-9ed5-46e6-acd3-29da032ea91d None admin] PATH_INFO: `/v3/users/046ce058984843509c9c689fc1b1fe83` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.394818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c98f0-84db-4b81-ae93-df4107e8f1a0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:24.395877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac3f40-9ed5-46e6-acd3-29da032ea91d None admin] RBAC: Authorizing `identity:get_user(user_id=046ce058984843509c9c689fc1b1fe83)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:24.397363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac3f40-9ed5-46e6-acd3-29da032ea91d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:24.397497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:24.399502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:24 2022] GET /identity/v3/users/046ce058984843509c9c689fc1b1fe83 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:24.405254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac3f40-9ed5-46e6-acd3-29da032ea91d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:24.422522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:24.497892 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c98f0-84db-4b81-ae93-df4107e8f1a0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:24.508930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac3f40-9ed5-46e6-acd3-29da032ea91d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:24.532418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c368750-a9ce-4b6c-909f-346ed938cc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:24.533277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c368750-a9ce-4b6c-909f-346ed938cc48 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.533557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c368750-a9ce-4b6c-909f-346ed938cc48 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.533851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c368750-a9ce-4b6c-909f-346ed938cc48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.545186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b94c8-1f1f-4ba4-997e-5dc395cda234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:24.545834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b94c8-1f1f-4ba4-997e-5dc395cda234 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.546120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b94c8-1f1f-4ba4-997e-5dc395cda234 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.546393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b94c8-1f1f-4ba4-997e-5dc395cda234 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.547550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b94c8-1f1f-4ba4-997e-5dc395cda234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:24.549005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b94c8-1f1f-4ba4-997e-5dc395cda234 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:24.550794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 10/18] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:24.552979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c368750-a9ce-4b6c-909f-346ed938cc48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:24.554478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c368750-a9ce-4b6c-909f-346ed938cc48 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:24.556829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b94c8-1f1f-4ba4-997e-5dc395cda234 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4c368750-a9ce-4b6c-909f-346ed938cc48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:33:24.574986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:24.576115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:33:24.577303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:33:24.577303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:33:24.577303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:24.577303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 9/19] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:24.581999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c368750-a9ce-4b6c-909f-346ed938cc48 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:24.641788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:24.647281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:24.669336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b94c8-1f1f-4ba4-997e-5dc395cda234 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:24.687259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c368750-a9ce-4b6c-909f-346ed938cc48 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:24.702888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686d8dc-8edd-484d-a2f3-752b1ba34a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:24.703499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d8dc-8edd-484d-a2f3-752b1ba34a7a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.703783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d8dc-8edd-484d-a2f3-752b1ba34a7a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.704055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d8dc-8edd-484d-a2f3-752b1ba34a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.704781 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686d8dc-8edd-484d-a2f3-752b1ba34a7a None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.domain.id=default, user.id=046ce058984843509c9c689fc1b1fe83) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:24.705088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686d8dc-8edd-484d-a2f3-752b1ba34a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:24.706527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686d8dc-8edd-484d-a2f3-752b1ba34a7a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:24.713842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 11/20] 10.222.0.65 () {56 vars in 1322 bytes} [Thu Aug 18 20:33:24 2022] GET /identity/v3/role_assignments?user.id=046ce058984843509c9c689fc1b1fe83&scope.domain.id=default&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:24.721358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd630e-9a63-4208-ad83-ab1564433bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:24.722011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd630e-9a63-4208-ad83-ab1564433bd8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.722290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd630e-9a63-4208-ad83-ab1564433bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.722564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd630e-9a63-4208-ad83-ab1564433bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.723268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd630e-9a63-4208-ad83-ab1564433bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:24.723576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd630e-9a63-4208-ad83-ab1564433bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:24.725018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd630e-9a63-4208-ad83-ab1564433bd8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:24.747517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 10/21] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:27.037308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5b790-2537-4d8f-a528-734f7d1f8b50 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.037840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5b790-2537-4d8f-a528-734f7d1f8b50 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.037840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5b790-2537-4d8f-a528-734f7d1f8b50 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.039925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 12/22] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:27.045620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a172c-0d0b-4d66-aa63-0bb6b2cd3dca None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.046046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a172c-0d0b-4d66-aa63-0bb6b2cd3dca None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.046216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a172c-0d0b-4d66-aa63-0bb6b2cd3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.075857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-550a172c-0d0b-4d66-aa63-0bb6b2cd3dca None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:27.077396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-550a172c-0d0b-4d66-aa63-0bb6b2cd3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:27.164850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 11/23] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:27.294310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03536b-2647-4f35-8248-28bf9a0e161c None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.294612 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03536b-2647-4f35-8248-28bf9a0e161c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.294811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03536b-2647-4f35-8248-28bf9a0e161c None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.296446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:27.301871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efd4b-b012-48bf-9712-fb20ac260df1 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.302396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efd4b-b012-48bf-9712-fb20ac260df1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.302887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efd4b-b012-48bf-9712-fb20ac260df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.331637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5d6efd4b-b012-48bf-9712-fb20ac260df1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:27.333177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5d6efd4b-b012-48bf-9712-fb20ac260df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:27.382696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:27.387462 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b7e19-4aca-4a20-9e90-c05efbae8de8 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.387755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b7e19-4aca-4a20-9e90-c05efbae8de8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.388038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b7e19-4aca-4a20-9e90-c05efbae8de8 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.389719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 14/25] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:27.394885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3274c9-f6df-456f-b5e6-c2ce3159c51e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.395177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3274c9-f6df-456f-b5e6-c2ce3159c51e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.395460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3274c9-f6df-456f-b5e6-c2ce3159c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.417698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 12/26] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:27.437788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05d4b5-8500-41d4-9579-0e6dcdd8e819 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.438097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05d4b5-8500-41d4-9579-0e6dcdd8e819 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.438348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05d4b5-8500-41d4-9579-0e6dcdd8e819 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.439890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:27.446048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbba7b-a4b2-435f-9efb-f0b84817511a None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.446680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbba7b-a4b2-435f-9efb-f0b84817511a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.447199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbba7b-a4b2-435f-9efb-f0b84817511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.447841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9f3274c9-f6df-456f-b5e6-c2ce3159c51e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:27.449094 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9f3274c9-f6df-456f-b5e6-c2ce3159c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:27.480040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-95fbba7b-a4b2-435f-9efb-f0b84817511a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:27.481643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-95fbba7b-a4b2-435f-9efb-f0b84817511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:27.597397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 14/28] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:27.638596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbba7b-a4b2-435f-9efb-f0b84817511a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:27.641276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 15/29] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:27.796354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbba7b-a4b2-435f-9efb-f0b84817511a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:27.814581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:27.838028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3274c9-f6df-456f-b5e6-c2ce3159c51e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:27.862256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb629b-6c6a-40f4-873b-82f61b71bde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:27.862845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb629b-6c6a-40f4-873b-82f61b71bde0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.863424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb629b-6c6a-40f4-873b-82f61b71bde0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.863424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb629b-6c6a-40f4-873b-82f61b71bde0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.881826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb629b-6c6a-40f4-873b-82f61b71bde0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:27.884222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb629b-6c6a-40f4-873b-82f61b71bde0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-c0eb629b-6c6a-40f4-873b-82f61b71bde0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:33:27.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:27.913272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:33:27.914621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:33:27.914621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:33:27.914621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:27.914621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 15/30] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:27.922805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb629b-6c6a-40f4-873b-82f61b71bde0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:27.986795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:28.018391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3274c9-f6df-456f-b5e6-c2ce3159c51e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:28.066353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473541e0-d4e0-43c5-99a4-f2c9ce7edfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:28.067022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473541e0-d4e0-43c5-99a4-f2c9ce7edfcb None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.067283 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473541e0-d4e0-43c5-99a4-f2c9ce7edfcb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.067553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473541e0-d4e0-43c5-99a4-f2c9ce7edfcb None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.068227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473541e0-d4e0-43c5-99a4-f2c9ce7edfcb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:28.069631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473541e0-d4e0-43c5-99a4-f2c9ce7edfcb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:28.177441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb629b-6c6a-40f4-873b-82f61b71bde0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:28.229127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 16/31] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Aug 18 20:33:27 2022] POST /identity/v3/roles => generated 219 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:33:28.230551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473541e0-d4e0-43c5-99a4-f2c9ce7edfcb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:28.233798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c90df6-46a6-458c-b9e2-d73f88e8632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:28.234675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90df6-46a6-458c-b9e2-d73f88e8632d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.235140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90df6-46a6-458c-b9e2-d73f88e8632d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.235417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90df6-46a6-458c-b9e2-d73f88e8632d None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.236091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c90df6-46a6-458c-b9e2-d73f88e8632d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:28.236543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c90df6-46a6-458c-b9e2-d73f88e8632d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:28.238153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c90df6-46a6-458c-b9e2-d73f88e8632d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:28.252158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 16/32] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:28.258405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c90df6-46a6-458c-b9e2-d73f88e8632d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:28.295659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:28.415923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473541e0-d4e0-43c5-99a4-f2c9ce7edfcb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:28.434551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c90df6-46a6-458c-b9e2-d73f88e8632d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:28.472834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751b0e6-a99e-4f45-804c-36557404b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:28.473478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751b0e6-a99e-4f45-804c-36557404b044 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.473763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751b0e6-a99e-4f45-804c-36557404b044 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.474096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751b0e6-a99e-4f45-804c-36557404b044 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.475277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751b0e6-a99e-4f45-804c-36557404b044 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:28.478077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751b0e6-a99e-4f45-804c-36557404b044 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:28.483319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:28.491163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e29bf-4422-441c-818f-90b4c5608fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:28.493033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e29bf-4422-441c-818f-90b4c5608fde None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.493320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e29bf-4422-441c-818f-90b4c5608fde None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.493590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e29bf-4422-441c-818f-90b4c5608fde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.507213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 17/33] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Aug 18 20:33:28 2022] POST /identity/v3/roles => generated 225 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:28.508700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751b0e6-a99e-4f45-804c-36557404b044 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:28.529699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e29bf-4422-441c-818f-90b4c5608fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-b57e29bf-4422-441c-818f-90b4c5608fde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:28.542996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:28.543956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:28.544750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 17/34] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:28.550789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e29bf-4422-441c-818f-90b4c5608fde None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:28.675657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751b0e6-a99e-4f45-804c-36557404b044 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:28.720272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db866910-489f-4ac3-902d-d56bce9b973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:28.721232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866910-489f-4ac3-902d-d56bce9b973a None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.721716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866910-489f-4ac3-902d-d56bce9b973a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.722192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866910-489f-4ac3-902d-d56bce9b973a None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.722982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db866910-489f-4ac3-902d-d56bce9b973a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:28.724685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db866910-489f-4ac3-902d-d56bce9b973a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:28.761372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:28.773703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 18/35] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:33:28 2022] POST /identity/v3/projects => generated 301 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:28.787489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e29bf-4422-441c-818f-90b4c5608fde None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:28.799085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2bf1-e183-4605-9cd1-9c3629789999 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.799574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2bf1-e183-4605-9cd1-9c3629789999 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.799667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2bf1-e183-4605-9cd1-9c3629789999 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.801188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:28.807936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58733159-44b0-4f2a-a5b4-15e4911631c4 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.808316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58733159-44b0-4f2a-a5b4-15e4911631c4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.808714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58733159-44b0-4f2a-a5b4-15e4911631c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.833828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d328b-3660-4cdc-bfc0-fb7ed8de7209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:28.834885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d328b-3660-4cdc-bfc0-fb7ed8de7209 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.835175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-58733159-44b0-4f2a-a5b4-15e4911631c4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:28.835581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d328b-3660-4cdc-bfc0-fb7ed8de7209 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.836094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d328b-3660-4cdc-bfc0-fb7ed8de7209 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.837019 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d328b-3660-4cdc-bfc0-fb7ed8de7209 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:28.837273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-58733159-44b0-4f2a-a5b4-15e4911631c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:28.837639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d328b-3660-4cdc-bfc0-fb7ed8de7209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:28.839435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d328b-3660-4cdc-bfc0-fb7ed8de7209 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:28.854917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 18/37] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:28.856813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c28bb-724c-4491-b273-e31ebf36ff75 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.857103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c28bb-724c-4491-b273-e31ebf36ff75 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.857387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c28bb-724c-4491-b273-e31ebf36ff75 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.858658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 19/38] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:28.863574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c28bb-724c-4491-b273-e31ebf36ff75 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:28.903478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:28.936572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 20/39] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:28.937692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad16b8-75b4-4fbd-aaa8-b892ca988195 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.937985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad16b8-75b4-4fbd-aaa8-b892ca988195 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.938265 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad16b8-75b4-4fbd-aaa8-b892ca988195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.965838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-48ad16b8-75b4-4fbd-aaa8-b892ca988195 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:28.967303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-48ad16b8-75b4-4fbd-aaa8-b892ca988195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:28.997550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c28bb-724c-4491-b273-e31ebf36ff75 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.049716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e960c4-e089-43dc-97ee-131a023a9f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.050364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e960c4-e089-43dc-97ee-131a023a9f32 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.050663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e960c4-e089-43dc-97ee-131a023a9f32 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.050998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e960c4-e089-43dc-97ee-131a023a9f32 None admin] PATH_INFO: `/v3/users/046ce058984843509c9c689fc1b1fe83` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.052500 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e960c4-e089-43dc-97ee-131a023a9f32 None admin] RBAC: Authorizing `identity:get_user(user_id=046ce058984843509c9c689fc1b1fe83)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.054190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e960c4-e089-43dc-97ee-131a023a9f32 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.056637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 20/40] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:28 2022] GET /identity/v3/users/046ce058984843509c9c689fc1b1fe83 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:29.061950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e960c4-e089-43dc-97ee-131a023a9f32 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.064498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 21/41] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:29.073917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.167723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e960c4-e089-43dc-97ee-131a023a9f32 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.219830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf4854-3dc6-4af2-b47f-eda56a352d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.220865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf4854-3dc6-4af2-b47f-eda56a352d2f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.221326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf4854-3dc6-4af2-b47f-eda56a352d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.221938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf4854-3dc6-4af2-b47f-eda56a352d2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.223201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf4854-3dc6-4af2-b47f-eda56a352d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.224669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf4854-3dc6-4af2-b47f-eda56a352d2f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.231023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 21/42] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:29.231191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad16b8-75b4-4fbd-aaa8-b892ca988195 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.233446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf4854-3dc6-4af2-b47f-eda56a352d2f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.320632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.346086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad16b8-75b4-4fbd-aaa8-b892ca988195 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.347394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf4854-3dc6-4af2-b47f-eda56a352d2f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.354863 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.382932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619465e-9425-4270-aff8-aa6b2c0bb8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.383797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ce4f3-003b-4696-ba56-69bcb118a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.383943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619465e-9425-4270-aff8-aa6b2c0bb8cb None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.384112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619465e-9425-4270-aff8-aa6b2c0bb8cb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.384335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619465e-9425-4270-aff8-aa6b2c0bb8cb None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.384467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ce4f3-003b-4696-ba56-69bcb118a365 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.384730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ce4f3-003b-4696-ba56-69bcb118a365 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.384992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619465e-9425-4270-aff8-aa6b2c0bb8cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.385127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ce4f3-003b-4696-ba56-69bcb118a365 None admin] PATH_INFO: `/v3/domains/default/users/046ce058984843509c9c689fc1b1fe83/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.386388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619465e-9425-4270-aff8-aa6b2c0bb8cb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.387078 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ce4f3-003b-4696-ba56-69bcb118a365 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=046ce058984843509c9c689fc1b1fe83, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.388515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ce4f3-003b-4696-ba56-69bcb118a365 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.402699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 22/43] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Aug 18 20:33:29 2022] POST /identity/v3/roles => generated 223 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:29.407827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619465e-9425-4270-aff8-aa6b2c0bb8cb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.511229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 22/44] 10.222.0.65 () {58 vars in 1361 bytes} [Thu Aug 18 20:33:29 2022] PUT /identity/v3/domains/default/users/046ce058984843509c9c689fc1b1fe83/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:33:29.660176 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619465e-9425-4270-aff8-aa6b2c0bb8cb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.696009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f2e29-3e20-4df4-9fee-15a07a0fd56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.696659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f2e29-3e20-4df4-9fee-15a07a0fd56c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.696951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f2e29-3e20-4df4-9fee-15a07a0fd56c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.697228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f2e29-3e20-4df4-9fee-15a07a0fd56c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.698346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f2e29-3e20-4df4-9fee-15a07a0fd56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.699865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f2e29-3e20-4df4-9fee-15a07a0fd56c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.701612 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 23/45] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:29.707461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ce4f3-003b-4696-ba56-69bcb118a365 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.816264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ce4f3-003b-4696-ba56-69bcb118a365 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.850744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd3ed7-2379-4e93-b79d-f330af0e111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.851864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3ed7-2379-4e93-b79d-f330af0e111f None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.852280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3ed7-2379-4e93-b79d-f330af0e111f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.852558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3ed7-2379-4e93-b79d-f330af0e111f None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.853229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd3ed7-2379-4e93-b79d-f330af0e111f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.854919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd3ed7-2379-4e93-b79d-f330af0e111f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.861111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.897916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 23/46] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:33:29 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:31.509806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae043fbc-0358-4b2b-bede-d306fc9edb47 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.510343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae043fbc-0358-4b2b-bede-d306fc9edb47 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.510343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae043fbc-0358-4b2b-bede-d306fc9edb47 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.511744 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 24/47] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:31.517248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e40154-1e30-4efa-adbb-fda5605507f3 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.517667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e40154-1e30-4efa-adbb-fda5605507f3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.517800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e40154-1e30-4efa-adbb-fda5605507f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.536497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c2e40154-1e30-4efa-adbb-fda5605507f3 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:31.538006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c2e40154-1e30-4efa-adbb-fda5605507f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:31.606722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:31.818422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa823-7aa0-4892-b0bd-dc5bd4f2daa6 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.818694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa823-7aa0-4892-b0bd-dc5bd4f2daa6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.819010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa823-7aa0-4892-b0bd-dc5bd4f2daa6 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.820383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 25/49] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:31.825686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bef9f-26c6-4d8b-91f9-5d5a5877a6bd None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.825979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bef9f-26c6-4d8b-91f9-5d5a5877a6bd None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.826257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bef9f-26c6-4d8b-91f9-5d5a5877a6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.843760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ee6bef9f-26c6-4d8b-91f9-5d5a5877a6bd None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:31.844949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ee6bef9f-26c6-4d8b-91f9-5d5a5877a6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:31.876456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fa823-7aa0-4892-b0bd-dc5bd4f2daa6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:31.915802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 25/50] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:31.919430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:31.991590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fa823-7aa0-4892-b0bd-dc5bd4f2daa6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.027142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e90e1-4f8b-4a1a-85b5-9ec9ead0da54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.027904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e90e1-4f8b-4a1a-85b5-9ec9ead0da54 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.028309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e90e1-4f8b-4a1a-85b5-9ec9ead0da54 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.028567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e90e1-4f8b-4a1a-85b5-9ec9ead0da54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.041597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e90e1-4f8b-4a1a-85b5-9ec9ead0da54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-0d1e90e1-4f8b-4a1a-85b5-9ec9ead0da54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:32.046404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:32.047290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:32.048061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 26/51] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:32.053548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bef9f-26c6-4d8b-91f9-5d5a5877a6bd None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:32.183814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e90e1-4f8b-4a1a-85b5-9ec9ead0da54 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:32.207154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:32.262849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bef9f-26c6-4d8b-91f9-5d5a5877a6bd None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.282727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:32.290221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e90e1-4f8b-4a1a-85b5-9ec9ead0da54 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.297358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244a632-adf8-43ac-9b5c-71460b88d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.298018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a632-adf8-43ac-9b5c-71460b88d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.298261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a632-adf8-43ac-9b5c-71460b88d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.298536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a632-adf8-43ac-9b5c-71460b88d9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.299243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244a632-adf8-43ac-9b5c-71460b88d9d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:32.299550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244a632-adf8-43ac-9b5c-71460b88d9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.300930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244a632-adf8-43ac-9b5c-71460b88d9d0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.309433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 26/52] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:32.314979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244a632-adf8-43ac-9b5c-71460b88d9d0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:32.327798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d52c7f-44eb-4211-ab32-b938087dddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.328438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d52c7f-44eb-4211-ab32-b938087dddf2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.328722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d52c7f-44eb-4211-ab32-b938087dddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.329003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d52c7f-44eb-4211-ab32-b938087dddf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.330119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d52c7f-44eb-4211-ab32-b938087dddf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.331616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d52c7f-44eb-4211-ab32-b938087dddf2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.333205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 27/53] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:32.339511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d52c7f-44eb-4211-ab32-b938087dddf2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:32.417942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244a632-adf8-43ac-9b5c-71460b88d9d0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.428443 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:32.444674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d52c7f-44eb-4211-ab32-b938087dddf2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.452676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6e03-11c3-43b6-9680-1066b89a72b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.453309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6e03-11c3-43b6-9680-1066b89a72b0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.453583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6e03-11c3-43b6-9680-1066b89a72b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.453856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6e03-11c3-43b6-9680-1066b89a72b0 None admin] PATH_INFO: `/v3/users/046ce058984843509c9c689fc1b1fe83` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.455007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e6e03-11c3-43b6-9680-1066b89a72b0 None admin] RBAC: Authorizing `identity:get_user(user_id=046ce058984843509c9c689fc1b1fe83)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.456432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e6e03-11c3-43b6-9680-1066b89a72b0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.458009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 27/54] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:32 2022] GET /identity/v3/users/046ce058984843509c9c689fc1b1fe83 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:32.463627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6e03-11c3-43b6-9680-1066b89a72b0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:32.478833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2a28-980c-4868-b045-4b36c9527114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.479453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2a28-980c-4868-b045-4b36c9527114 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.479734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2a28-980c-4868-b045-4b36c9527114 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.480006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2a28-980c-4868-b045-4b36c9527114 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.480645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de2a28-980c-4868-b045-4b36c9527114 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.482120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de2a28-980c-4868-b045-4b36c9527114 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.510651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 28/55] 10.222.0.65 () {60 vars in 1140 bytes} [Thu Aug 18 20:33:32 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:33:32.575875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6e03-11c3-43b6-9680-1066b89a72b0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.617975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4557683-5351-4fec-b5c6-c5ebf854219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.618623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557683-5351-4fec-b5c6-c5ebf854219e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.618949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557683-5351-4fec-b5c6-c5ebf854219e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.619232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557683-5351-4fec-b5c6-c5ebf854219e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.620485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4557683-5351-4fec-b5c6-c5ebf854219e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.621974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4557683-5351-4fec-b5c6-c5ebf854219e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.623896 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 28/56] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:32.629905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2a28-980c-4868-b045-4b36c9527114 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:32.648414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:32.739066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2a28-980c-4868-b045-4b36c9527114 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.774309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7c680-9cea-4e75-9608-e7bad9618813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.774802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7c680-9cea-4e75-9608-e7bad9618813 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.775095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7c680-9cea-4e75-9608-e7bad9618813 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.775374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7c680-9cea-4e75-9608-e7bad9618813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.776117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7c680-9cea-4e75-9608-e7bad9618813 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.domain.id=default, user.id=046ce058984843509c9c689fc1b1fe83) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:32.776425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7c680-9cea-4e75-9608-e7bad9618813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.777883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7c680-9cea-4e75-9608-e7bad9618813 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.783737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 29/57] 10.222.0.65 () {56 vars in 1322 bytes} [Thu Aug 18 20:33:32 2022] GET /identity/v3/role_assignments?user.id=046ce058984843509c9c689fc1b1fe83&scope.domain.id=default&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:34.471616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f64314-60fa-4b52-a6ef-b30b3969df11 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.472137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f64314-60fa-4b52-a6ef-b30b3969df11 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.472247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f64314-60fa-4b52-a6ef-b30b3969df11 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.473517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 29/58] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:34.479531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3de5d-c625-4ec3-8393-618fe7352816 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.479927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3de5d-c625-4ec3-8393-618fe7352816 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.480078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3de5d-c625-4ec3-8393-618fe7352816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.498072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5ac3de5d-c625-4ec3-8393-618fe7352816 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:34.499380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5ac3de5d-c625-4ec3-8393-618fe7352816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:34.573819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 30/59] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:34.856824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f64314-60fa-4b52-a6ef-b30b3969df11 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:34.905322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:34.958810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f64314-60fa-4b52-a6ef-b30b3969df11 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:34.992216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbce36-14fb-41e4-ad2f-639e8835222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:34.998321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbce36-14fb-41e4-ad2f-639e8835222d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.998321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbce36-14fb-41e4-ad2f-639e8835222d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.998321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbce36-14fb-41e4-ad2f-639e8835222d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.998321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbce36-14fb-41e4-ad2f-639e8835222d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:34.998321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbce36-14fb-41e4-ad2f-639e8835222d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:34.998321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 30/60] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:35.003185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3de5d-c625-4ec3-8393-618fe7352816 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:35.014380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:35.103658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3de5d-c625-4ec3-8393-618fe7352816 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:35.136802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf48697-dd40-4cc3-a081-d13b16018686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:35.137350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48697-dd40-4cc3-a081-d13b16018686 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:35.137636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48697-dd40-4cc3-a081-d13b16018686 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:35.137916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48697-dd40-4cc3-a081-d13b16018686 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:35.138570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf48697-dd40-4cc3-a081-d13b16018686 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:35.140086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf48697-dd40-4cc3-a081-d13b16018686 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:35.167926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 31/61] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:35 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:38.225707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d853e-347e-46a4-b050-dac33b485fed None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.226413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d853e-347e-46a4-b050-dac33b485fed None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.226413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d853e-347e-46a4-b050-dac33b485fed None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.227929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 31/62] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:38.233864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a30434-d317-4a31-b9f1-299a8000a641 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.234706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a30434-d317-4a31-b9f1-299a8000a641 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.235222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a30434-d317-4a31-b9f1-299a8000a641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.259473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a8a30434-d317-4a31-b9f1-299a8000a641 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:38.261021 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a8a30434-d317-4a31-b9f1-299a8000a641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:38.352571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:38.369312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 32/63] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:38.514095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd9e44-5f42-4f68-ae39-9130ae744d7a None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.514695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd9e44-5f42-4f68-ae39-9130ae744d7a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.515209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd9e44-5f42-4f68-ae39-9130ae744d7a None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.516772 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 32/64] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:38.522500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157086c-088a-4466-9837-c5ceff0b6fe3 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.522951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157086c-088a-4466-9837-c5ceff0b6fe3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.523405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157086c-088a-4466-9837-c5ceff0b6fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.547836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3157086c-088a-4466-9837-c5ceff0b6fe3 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:38.549056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3157086c-088a-4466-9837-c5ceff0b6fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:38.565388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fd1f1-1b78-4989-9552-656c9b1bfc36 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.566010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fd1f1-1b78-4989-9552-656c9b1bfc36 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.566483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fd1f1-1b78-4989-9552-656c9b1bfc36 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.568068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 33/65] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:38.574174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c6116-6bc3-49ab-9ba3-8b2b4f41025d None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.574738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c6116-6bc3-49ab-9ba3-8b2b4f41025d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.575275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c6116-6bc3-49ab-9ba3-8b2b4f41025d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.608113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-500c6116-6bc3-49ab-9ba3-8b2b4f41025d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:38.609363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-500c6116-6bc3-49ab-9ba3-8b2b4f41025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:38.672638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 33/66] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:38.741051 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 34/67] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:38.762495 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ffbac-0649-4ac7-b436-5fd75386ca2d None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.762828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ffbac-0649-4ac7-b436-5fd75386ca2d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.763084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ffbac-0649-4ac7-b436-5fd75386ca2d None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.764637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 34/68] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:38.769471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f5245-8bbd-4e6c-ac64-1749c05a1ac4 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.769758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f5245-8bbd-4e6c-ac64-1749c05a1ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.770053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f5245-8bbd-4e6c-ac64-1749c05a1ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.771627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e246dc-3f95-4b77-8c95-31213c36bfb5 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.772116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e246dc-3f95-4b77-8c95-31213c36bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.772591 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e246dc-3f95-4b77-8c95-31213c36bfb5 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.774643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 35/69] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:38.779924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e7102-a754-4e79-a589-3673af133323 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.780406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e7102-a754-4e79-a589-3673af133323 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.780841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e7102-a754-4e79-a589-3673af133323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.791493 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-298f5245-8bbd-4e6c-ac64-1749c05a1ac4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:38.792732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-298f5245-8bbd-4e6c-ac64-1749c05a1ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:38.801733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0a3e7102-a754-4e79-a589-3673af133323 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:38.803569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0a3e7102-a754-4e79-a589-3673af133323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:38.866168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:38.867994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 35/70] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:38.869102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f5245-8bbd-4e6c-ac64-1749c05a1ac4 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:38.899916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 36/71] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:38.936281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:38.983825 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f5245-8bbd-4e6c-ac64-1749c05a1ac4 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.019660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66c632-e0a1-44f7-87a1-8fca8b5078d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.020622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66c632-e0a1-44f7-87a1-8fca8b5078d0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.021121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66c632-e0a1-44f7-87a1-8fca8b5078d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.021583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66c632-e0a1-44f7-87a1-8fca8b5078d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.033739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66c632-e0a1-44f7-87a1-8fca8b5078d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:39.035106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e7102-a754-4e79-a589-3673af133323 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-4c66c632-e0a1-44f7-87a1-8fca8b5078d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:39.039538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:39.040390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:39.041162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:39.043492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 36/72] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:39.048985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66c632-e0a1-44f7-87a1-8fca8b5078d0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.173451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e7102-a754-4e79-a589-3673af133323 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.183044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66c632-e0a1-44f7-87a1-8fca8b5078d0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.200303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:39.216576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b510c8-6380-47e0-b345-ff5116786f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.217505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b510c8-6380-47e0-b345-ff5116786f71 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.217790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b510c8-6380-47e0-b345-ff5116786f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.218075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b510c8-6380-47e0-b345-ff5116786f71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.223735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b096d96-1039-4fe8-b840-cd4def6bc24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.224356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b096d96-1039-4fe8-b840-cd4def6bc24d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.224638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b096d96-1039-4fe8-b840-cd4def6bc24d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.224912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b096d96-1039-4fe8-b840-cd4def6bc24d None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.225590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b096d96-1039-4fe8-b840-cd4def6bc24d None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:39.226046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b096d96-1039-4fe8-b840-cd4def6bc24d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:39.227747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b096d96-1039-4fe8-b840-cd4def6bc24d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:39.230116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b510c8-6380-47e0-b345-ff5116786f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-d7b510c8-6380-47e0-b345-ff5116786f71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:39.236131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:39.237148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:39.238068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:39.238820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 37/73] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:39.238820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b096d96-1039-4fe8-b840-cd4def6bc24d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.242791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 37/74] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:39.243673 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b510c8-6380-47e0-b345-ff5116786f71 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.279498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:39.340567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b096d96-1039-4fe8-b840-cd4def6bc24d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.348366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b510c8-6380-47e0-b345-ff5116786f71 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.374790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62089cc6-ca8e-4810-b93e-76de433bb4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.375452 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62089cc6-ca8e-4810-b93e-76de433bb4c3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.375736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62089cc6-ca8e-4810-b93e-76de433bb4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.376014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62089cc6-ca8e-4810-b93e-76de433bb4c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.383628 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c541e3-1186-4adb-8a4d-16fb0595184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.384259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c541e3-1186-4adb-8a4d-16fb0595184a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.384542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c541e3-1186-4adb-8a4d-16fb0595184a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.384815 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c541e3-1186-4adb-8a4d-16fb0595184a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.385947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c541e3-1186-4adb-8a4d-16fb0595184a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:39.387004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62089cc6-ca8e-4810-b93e-76de433bb4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:39.387436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c541e3-1186-4adb-8a4d-16fb0595184a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:39.389013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 38/75] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:39.393717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c541e3-1186-4adb-8a4d-16fb0595184a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-62089cc6-ca8e-4810-b93e-76de433bb4c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:39.393792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:39.394590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:39.395409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 38/76] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:39.396049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62089cc6-ca8e-4810-b93e-76de433bb4c3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.432155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:39.494888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c541e3-1186-4adb-8a4d-16fb0595184a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.496411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:39.497188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62089cc6-ca8e-4810-b93e-76de433bb4c3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.531196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f84bf-d946-4cc5-b260-1933440a6f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.531757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f84bf-d946-4cc5-b260-1933440a6f24 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.532042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f84bf-d946-4cc5-b260-1933440a6f24 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.532316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f84bf-d946-4cc5-b260-1933440a6f24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.533380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49186a44-edbe-4914-a007-3f548cfd1a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.534015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49186a44-edbe-4914-a007-3f548cfd1a8d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.534301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49186a44-edbe-4914-a007-3f548cfd1a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.534578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49186a44-edbe-4914-a007-3f548cfd1a8d None admin] PATH_INFO: `/v3/users/71a15ac6f0154871b851e8c126489c7b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.543022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f84bf-d946-4cc5-b260-1933440a6f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-b86f84bf-d946-4cc5-b260-1933440a6f24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:39.547837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:39.548721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:39.549496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:39.550721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49186a44-edbe-4914-a007-3f548cfd1a8d None admin] RBAC: Authorizing `identity:get_user(user_id=71a15ac6f0154871b851e8c126489c7b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:39.550824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 39/77] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:39.550982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49186a44-edbe-4914-a007-3f548cfd1a8d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:39.551053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f84bf-d946-4cc5-b260-1933440a6f24 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.551333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 39/78] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/users/71a15ac6f0154871b851e8c126489c7b => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:39.552157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49186a44-edbe-4914-a007-3f548cfd1a8d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.654801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:39.655694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f84bf-d946-4cc5-b260-1933440a6f24 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.662198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49186a44-edbe-4914-a007-3f548cfd1a8d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.690678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a06858-1d56-416a-ac88-b0c14136c167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.691345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a06858-1d56-416a-ac88-b0c14136c167 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.691627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a06858-1d56-416a-ac88-b0c14136c167 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.692020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a06858-1d56-416a-ac88-b0c14136c167 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.692755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a06858-1d56-416a-ac88-b0c14136c167 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:39.693008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a06858-1d56-416a-ac88-b0c14136c167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:39.694425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a06858-1d56-416a-ac88-b0c14136c167 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:39.696250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462edf-d9fe-4390-832c-f6125caf3e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.696870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462edf-d9fe-4390-832c-f6125caf3e5b None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.697155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462edf-d9fe-4390-832c-f6125caf3e5b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.697431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462edf-d9fe-4390-832c-f6125caf3e5b None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.698075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d462edf-d9fe-4390-832c-f6125caf3e5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:39.699547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d462edf-d9fe-4390-832c-f6125caf3e5b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:39.702972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 40/79] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:39.708000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a06858-1d56-416a-ac88-b0c14136c167 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.722025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 40/80] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:39 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:39.724037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462edf-d9fe-4390-832c-f6125caf3e5b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.732458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:39.821424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a06858-1d56-416a-ac88-b0c14136c167 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.856330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462edf-d9fe-4390-832c-f6125caf3e5b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.864786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17ef44-9e84-4eb8-a063-ba70c332744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.865438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17ef44-9e84-4eb8-a063-ba70c332744f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.865729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17ef44-9e84-4eb8-a063-ba70c332744f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.866006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17ef44-9e84-4eb8-a063-ba70c332744f None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.866855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17ef44-9e84-4eb8-a063-ba70c332744f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:39.867159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17ef44-9e84-4eb8-a063-ba70c332744f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:39.868564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17ef44-9e84-4eb8-a063-ba70c332744f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:39.883470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 41/81] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:39.884304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17ef44-9e84-4eb8-a063-ba70c332744f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.901202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900968f-42f0-421d-acf8-37a6992662f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.901833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900968f-42f0-421d-acf8-37a6992662f4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.902118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900968f-42f0-421d-acf8-37a6992662f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.902397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900968f-42f0-421d-acf8-37a6992662f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.922387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:39.986352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900968f-42f0-421d-acf8-37a6992662f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:39.988294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900968f-42f0-421d-acf8-37a6992662f4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:39.999242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.016328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17ef44-9e84-4eb8-a063-ba70c332744f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.061269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd2983-1344-4c7e-a5d2-d5e64ef37e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.062451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd2983-1344-4c7e-a5d2-d5e64ef37e1e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.062905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd2983-1344-4c7e-a5d2-d5e64ef37e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.063324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd2983-1344-4c7e-a5d2-d5e64ef37e1e None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.064389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd2983-1344-4c7e-a5d2-d5e64ef37e1e None admin] RBAC: Adding query filter params (name=member) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:40.065282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd2983-1344-4c7e-a5d2-d5e64ef37e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.067123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd2983-1344-4c7e-a5d2-d5e64ef37e1e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.079643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 42/82] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:40.080845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd2983-1344-4c7e-a5d2-d5e64ef37e1e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.129602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 41/83] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:40.130294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900968f-42f0-421d-acf8-37a6992662f4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.188978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.209238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd2983-1344-4c7e-a5d2-d5e64ef37e1e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.242957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900968f-42f0-421d-acf8-37a6992662f4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.248690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e300660-955a-4734-85e8-f85d962ff099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.249346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e300660-955a-4734-85e8-f85d962ff099 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.249634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e300660-955a-4734-85e8-f85d962ff099 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.249915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e300660-955a-4734-85e8-f85d962ff099 None admin] PATH_INFO: `/v3/users/71a15ac6f0154871b851e8c126489c7b` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.251116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e300660-955a-4734-85e8-f85d962ff099 None admin] RBAC: Authorizing `identity:get_user(user_id=71a15ac6f0154871b851e8c126489c7b)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.252576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e300660-955a-4734-85e8-f85d962ff099 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.254362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 43/84] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/users/71a15ac6f0154871b851e8c126489c7b => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:40.255222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e300660-955a-4734-85e8-f85d962ff099 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.277030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.283468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ec8b4-3908-45fe-86e9-444c7d5f0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.284372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ec8b4-3908-45fe-86e9-444c7d5f0f13 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.284824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ec8b4-3908-45fe-86e9-444c7d5f0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.285269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ec8b4-3908-45fe-86e9-444c7d5f0f13 None admin] PATH_INFO: `/v3/users/046ce058984843509c9c689fc1b1fe83` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.286591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ec8b4-3908-45fe-86e9-444c7d5f0f13 None admin] RBAC: Authorizing `identity:get_user(user_id=046ce058984843509c9c689fc1b1fe83)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.288388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ec8b4-3908-45fe-86e9-444c7d5f0f13 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.290492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 42/85] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/users/046ce058984843509c9c689fc1b1fe83 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:40.291501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ec8b4-3908-45fe-86e9-444c7d5f0f13 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.374885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e300660-955a-4734-85e8-f85d962ff099 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.399863 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ec8b4-3908-45fe-86e9-444c7d5f0f13 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.411289 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9e872-5c35-4397-94b0-7c8638e57a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.411943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9e872-5c35-4397-94b0-7c8638e57a48 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.412231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9e872-5c35-4397-94b0-7c8638e57a48 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.412513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9e872-5c35-4397-94b0-7c8638e57a48 None admin] PATH_INFO: `/v3/users/71a15ac6f0154871b851e8c126489c7b` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.413856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9e872-5c35-4397-94b0-7c8638e57a48 None admin] RBAC: Authorizing `identity:get_user(user_id=71a15ac6f0154871b851e8c126489c7b)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.416354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9e872-5c35-4397-94b0-7c8638e57a48 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.419352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 44/86] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/users/71a15ac6f0154871b851e8c126489c7b => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:40.420084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9e872-5c35-4397-94b0-7c8638e57a48 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.425045 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.440003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc343f8-48ea-4b1b-a102-dd6ec4e7df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.440984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc343f8-48ea-4b1b-a102-dd6ec4e7df59 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.441459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc343f8-48ea-4b1b-a102-dd6ec4e7df59 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.441944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc343f8-48ea-4b1b-a102-dd6ec4e7df59 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.443317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc343f8-48ea-4b1b-a102-dd6ec4e7df59 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.445088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc343f8-48ea-4b1b-a102-dd6ec4e7df59 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.446988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 43/87] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:40.447955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc343f8-48ea-4b1b-a102-dd6ec4e7df59 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.523184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.542666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9e872-5c35-4397-94b0-7c8638e57a48 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.557416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc343f8-48ea-4b1b-a102-dd6ec4e7df59 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.584814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc5e4-ab68-45b1-9ce8-72a6067998db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.585505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc5e4-ab68-45b1-9ce8-72a6067998db None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.585788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc5e4-ab68-45b1-9ce8-72a6067998db None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.586066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc5e4-ab68-45b1-9ce8-72a6067998db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.599595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36bf7e-65f1-4208-9d2e-62a6c7cc84e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.600561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36bf7e-65f1-4208-9d2e-62a6c7cc84e5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.601564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36bf7e-65f1-4208-9d2e-62a6c7cc84e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.602051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36bf7e-65f1-4208-9d2e-62a6c7cc84e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.659762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.668855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fc5e4-ab68-45b1-9ce8-72a6067998db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.670360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fc5e4-ab68-45b1-9ce8-72a6067998db None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.675124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36bf7e-65f1-4208-9d2e-62a6c7cc84e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.676829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36bf7e-65f1-4208-9d2e-62a6c7cc84e5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.764992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.781961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 44/88] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:40.782991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36bf7e-65f1-4208-9d2e-62a6c7cc84e5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.784928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 45/89] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:40.786321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc5e4-ab68-45b1-9ce8-72a6067998db None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.871449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.892125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36bf7e-65f1-4208-9d2e-62a6c7cc84e5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.899335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc5e4-ab68-45b1-9ce8-72a6067998db None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.941997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290385c7-b6ef-43b0-a97d-fda908e1d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.942805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290385c7-b6ef-43b0-a97d-fda908e1d5fb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.943289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290385c7-b6ef-43b0-a97d-fda908e1d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.943628 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04130aa1-6788-4cfa-9133-f0fbdae0c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.943751 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290385c7-b6ef-43b0-a97d-fda908e1d5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.944295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04130aa1-6788-4cfa-9133-f0fbdae0c23f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.944658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04130aa1-6788-4cfa-9133-f0fbdae0c23f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.945100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04130aa1-6788-4cfa-9133-f0fbdae0c23f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.945905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04130aa1-6788-4cfa-9133-f0fbdae0c23f None admin] RBAC: Adding query filter params (role.id=b7551ed385954688a565792f95efda9c, scope.project.id=65e5d2374d6d489d9ce0f7c913737262, user.id=71a15ac6f0154871b851e8c126489c7b) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:40.946215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04130aa1-6788-4cfa-9133-f0fbdae0c23f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.949050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04130aa1-6788-4cfa-9133-f0fbdae0c23f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.958955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 46/90] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/role_assignments?user.id=71a15ac6f0154871b851e8c126489c7b&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=b7551ed385954688a565792f95efda9c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:40.959863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04130aa1-6788-4cfa-9133-f0fbdae0c23f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:41.026525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:41.094749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04130aa1-6788-4cfa-9133-f0fbdae0c23f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:41.129023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290385c7-b6ef-43b0-a97d-fda908e1d5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:41.130566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290385c7-b6ef-43b0-a97d-fda908e1d5fb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:41.138091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dfd9c-ee62-4833-92fd-c55836233863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:41.138751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dfd9c-ee62-4833-92fd-c55836233863 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:41.139060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dfd9c-ee62-4833-92fd-c55836233863 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:41.139336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dfd9c-ee62-4833-92fd-c55836233863 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:41.140515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dfd9c-ee62-4833-92fd-c55836233863 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:41.141987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dfd9c-ee62-4833-92fd-c55836233863 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:41.143703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 47/91] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:41.144572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dfd9c-ee62-4833-92fd-c55836233863 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:41.269979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dfd9c-ee62-4833-92fd-c55836233863 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:41.289057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:41.308775 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:41.312578 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964aecd-c540-4160-97e8-d38c061a0cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:41.313230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964aecd-c540-4160-97e8-d38c061a0cf7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:41.313509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964aecd-c540-4160-97e8-d38c061a0cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:41.313783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964aecd-c540-4160-97e8-d38c061a0cf7 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:41.314954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964aecd-c540-4160-97e8-d38c061a0cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:41.317536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964aecd-c540-4160-97e8-d38c061a0cf7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:41.319478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 48/92] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:41 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:41.320407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964aecd-c540-4160-97e8-d38c061a0cf7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:41.368190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 45/93] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:41.369508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290385c7-b6ef-43b0-a97d-fda908e1d5fb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:41.448922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964aecd-c540-4160-97e8-d38c061a0cf7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:41.488209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1a939-68b9-43fb-84c8-f26ce820167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:41.488830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1a939-68b9-43fb-84c8-f26ce820167f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:41.489119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1a939-68b9-43fb-84c8-f26ce820167f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:41.489382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1a939-68b9-43fb-84c8-f26ce820167f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:41.490183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1a939-68b9-43fb-84c8-f26ce820167f None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=65e5d2374d6d489d9ce0f7c913737262, user.id=046ce058984843509c9c689fc1b1fe83) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:41.490495 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1a939-68b9-43fb-84c8-f26ce820167f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:41.492024 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1a939-68b9-43fb-84c8-f26ce820167f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:41.498748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 49/94] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:41 2022] GET /identity/v3/role_assignments?user.id=046ce058984843509c9c689fc1b1fe83&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:41.499581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1a939-68b9-43fb-84c8-f26ce820167f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:41.563038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:41.632705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1a939-68b9-43fb-84c8-f26ce820167f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:41.678349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7e1f4-580e-4faf-ac91-c683518ae4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:41.680820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e1f4-580e-4faf-ac91-c683518ae4b5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:41.681294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e1f4-580e-4faf-ac91-c683518ae4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:41.681705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e1f4-580e-4faf-ac91-c683518ae4b5 None admin] PATH_INFO: `/v3/projects/8795fc556c9647b7a8942bc680a4bacc` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:41.683455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7e1f4-580e-4faf-ac91-c683518ae4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=8795fc556c9647b7a8942bc680a4bacc)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:41.685242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7e1f4-580e-4faf-ac91-c683518ae4b5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:41.685652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290385c7-b6ef-43b0-a97d-fda908e1d5fb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:41.687930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 50/95] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:41 2022] GET /identity/v3/projects/8795fc556c9647b7a8942bc680a4bacc => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:41.697615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7e1f4-580e-4faf-ac91-c683518ae4b5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:41.772704 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5914f92-c04d-4eca-8dc3-e2ad05f29b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:41.773770 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914f92-c04d-4eca-8dc3-e2ad05f29b3f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:41.774191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914f92-c04d-4eca-8dc3-e2ad05f29b3f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:41.774622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914f92-c04d-4eca-8dc3-e2ad05f29b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:41.775730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5914f92-c04d-4eca-8dc3-e2ad05f29b3f None admin] RBAC: Adding query filter params (role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=65e5d2374d6d489d9ce0f7c913737262, user.id=71a15ac6f0154871b851e8c126489c7b) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:41.776389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5914f92-c04d-4eca-8dc3-e2ad05f29b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:41.778120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5914f92-c04d-4eca-8dc3-e2ad05f29b3f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:41.785403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 46/96] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:41 2022] GET /identity/v3/role_assignments?user.id=71a15ac6f0154871b851e8c126489c7b&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 259 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:41.847533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7e1f4-580e-4faf-ac91-c683518ae4b5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:41.880114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:41.902338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515589d-8687-4bf3-8ed2-bc0c1738eb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:41.902988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515589d-8687-4bf3-8ed2-bc0c1738eb2e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:41.903269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515589d-8687-4bf3-8ed2-bc0c1738eb2e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:41.903540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515589d-8687-4bf3-8ed2-bc0c1738eb2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:41.904273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515589d-8687-4bf3-8ed2-bc0c1738eb2e None admin] RBAC: Adding query filter params (role.id=b7551ed385954688a565792f95efda9c, scope.project.id=8795fc556c9647b7a8942bc680a4bacc, user.id=71a15ac6f0154871b851e8c126489c7b) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:41.904581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515589d-8687-4bf3-8ed2-bc0c1738eb2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:41.906039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515589d-8687-4bf3-8ed2-bc0c1738eb2e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:41.912258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 51/97] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:41 2022] GET /identity/v3/role_assignments?user.id=71a15ac6f0154871b851e8c126489c7b&scope.project.id=8795fc556c9647b7a8942bc680a4bacc&role.id=b7551ed385954688a565792f95efda9c => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:42.245659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ced934-d5f0-4223-898d-5e1390819a19 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:42.246029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ced934-d5f0-4223-898d-5e1390819a19 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:42.246221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ced934-d5f0-4223-898d-5e1390819a19 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:42.248889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 47/98] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:42.254255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68202ec5-1ba4-42e5-a03d-a456f9257e8a None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:42.254546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68202ec5-1ba4-42e5-a03d-a456f9257e8a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:42.254859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68202ec5-1ba4-42e5-a03d-a456f9257e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:42.278408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-68202ec5-1ba4-42e5-a03d-a456f9257e8a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:42.279663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-68202ec5-1ba4-42e5-a03d-a456f9257e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:42.321437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24892da-32fb-4c46-bd8f-3f8b3903a535 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:42.321938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24892da-32fb-4c46-bd8f-3f8b3903a535 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:42.322017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24892da-32fb-4c46-bd8f-3f8b3903a535 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:42.323570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 48/99] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:42.334622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bfa54-6193-4b5c-b563-ca13baa7cd17 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:42.334926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bfa54-6193-4b5c-b563-ca13baa7cd17 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:42.335257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bfa54-6193-4b5c-b563-ca13baa7cd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:42.379854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-506bfa54-6193-4b5c-b563-ca13baa7cd17 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:42.381089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-506bfa54-6193-4b5c-b563-ca13baa7cd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:42.382540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 52/100] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:42.469317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:42.501345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 49/101] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:42.747706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68202ec5-1ba4-42e5-a03d-a456f9257e8a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:42.871274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68202ec5-1ba4-42e5-a03d-a456f9257e8a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:42.885647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:42.911414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911c852-6be6-4a79-9a0b-9def8e183851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:42.912054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911c852-6be6-4a79-9a0b-9def8e183851 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:42.912334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911c852-6be6-4a79-9a0b-9def8e183851 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:42.912604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911c852-6be6-4a79-9a0b-9def8e183851 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:42.924168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911c852-6be6-4a79-9a0b-9def8e183851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-8911c852-6be6-4a79-9a0b-9def8e183851 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:42.928951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:42.929803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:42.931263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 53/102] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:42.935850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bfa54-6193-4b5c-b563-ca13baa7cd17 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:43.057010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911c852-6be6-4a79-9a0b-9def8e183851 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:43.106527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bfa54-6193-4b5c-b563-ca13baa7cd17 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:43.195563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c13b2-8599-4070-a778-b321b28a384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:43.196389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c13b2-8599-4070-a778-b321b28a384c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.196495 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c13b2-8599-4070-a778-b321b28a384c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.196748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c13b2-8599-4070-a778-b321b28a384c None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.197441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c13b2-8599-4070-a778-b321b28a384c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:43.197744 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c13b2-8599-4070-a778-b321b28a384c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:43.199192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c13b2-8599-4070-a778-b321b28a384c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:43.214231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 50/103] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:43.219363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c13b2-8599-4070-a778-b321b28a384c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:43.262161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911c852-6be6-4a79-9a0b-9def8e183851 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:43.286309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:43.327994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576553-5786-4d6c-b14a-3f8a1afacbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:43.328657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576553-5786-4d6c-b14a-3f8a1afacbee None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.328929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576553-5786-4d6c-b14a-3f8a1afacbee None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.329201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576553-5786-4d6c-b14a-3f8a1afacbee None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.333795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52576553-5786-4d6c-b14a-3f8a1afacbee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:43.337316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52576553-5786-4d6c-b14a-3f8a1afacbee None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:43.339204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 54/104] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:43.347742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576553-5786-4d6c-b14a-3f8a1afacbee None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:43.374475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c13b2-8599-4070-a778-b321b28a384c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:43.410844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d97ff-eddf-4fcc-917b-ae26774d327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:43.411843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d97ff-eddf-4fcc-917b-ae26774d327e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.412320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d97ff-eddf-4fcc-917b-ae26774d327e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.412826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d97ff-eddf-4fcc-917b-ae26774d327e None admin] PATH_INFO: `/v3/users/18f8b85eb80f4c6a945d78b0675304a0` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.421059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:43.428415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d97ff-eddf-4fcc-917b-ae26774d327e None admin] RBAC: Authorizing `identity:get_user(user_id=18f8b85eb80f4c6a945d78b0675304a0)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:43.430735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d97ff-eddf-4fcc-917b-ae26774d327e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:43.432727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 51/105] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:43 2022] GET /identity/v3/users/18f8b85eb80f4c6a945d78b0675304a0 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:43.438518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d97ff-eddf-4fcc-917b-ae26774d327e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:43.549457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:43.560423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d97ff-eddf-4fcc-917b-ae26774d327e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:43.580798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576553-5786-4d6c-b14a-3f8a1afacbee None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:43.623426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb087b5-929e-4de6-b698-edb18f6d2fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:43.624073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb087b5-929e-4de6-b698-edb18f6d2fda None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.624357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb087b5-929e-4de6-b698-edb18f6d2fda None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.624632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb087b5-929e-4de6-b698-edb18f6d2fda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.724069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e296d-ace9-4c35-b69a-fe2240edc5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:43.724712 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e296d-ace9-4c35-b69a-fe2240edc5ac None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.724992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e296d-ace9-4c35-b69a-fe2240edc5ac None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.725264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e296d-ace9-4c35-b69a-fe2240edc5ac None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.726959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e296d-ace9-4c35-b69a-fe2240edc5ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:43.728427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e296d-ace9-4c35-b69a-fe2240edc5ac None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:43.733869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb087b5-929e-4de6-b698-edb18f6d2fda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:43.738788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb087b5-929e-4de6-b698-edb18f6d2fda None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:43.794134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 55/106] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:33:43 2022] POST /identity/v3/projects => generated 302 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:43.893166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:43.901336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 52/107] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:43.903175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e296d-ace9-4c35-b69a-fe2240edc5ac None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.024825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:44.036919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e296d-ace9-4c35-b69a-fe2240edc5ac None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:44.087952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e06d9-5459-4167-9de9-38e68ea58e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:44.088986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e06d9-5459-4167-9de9-38e68ea58e2c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.089459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e06d9-5459-4167-9de9-38e68ea58e2c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.089929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e06d9-5459-4167-9de9-38e68ea58e2c None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.092186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e06d9-5459-4167-9de9-38e68ea58e2c None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:44.093389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b68e9-a55f-47aa-ae57-6b0c5fe699f5 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.093653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e06d9-5459-4167-9de9-38e68ea58e2c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:44.093751 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b68e9-a55f-47aa-ae57-6b0c5fe699f5 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.093945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b68e9-a55f-47aa-ae57-6b0c5fe699f5 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.095628 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 56/109] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:43 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:44.095742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 53/109] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:44.101221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6263a-9bb4-42c3-9693-51b620086d84 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.101510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6263a-9bb4-42c3-9693-51b620086d84 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.101784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6263a-9bb4-42c3-9693-51b620086d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.112624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e06d9-5459-4167-9de9-38e68ea58e2c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.134812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-47c6263a-9bb4-42c3-9693-51b620086d84 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:44.136016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-47c6263a-9bb4-42c3-9693-51b620086d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:44.221419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 54/110] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:44.222834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2fb56-3344-4011-b666-6f0911f35bef None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.223124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2fb56-3344-4011-b666-6f0911f35bef None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.223396 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2fb56-3344-4011-b666-6f0911f35bef None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.225042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 55/111] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:44.233716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2986f0-3f20-457f-92c5-c9ad2fedd24a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.235148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2986f0-3f20-457f-92c5-c9ad2fedd24a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.235440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2986f0-3f20-457f-92c5-c9ad2fedd24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.278929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-df2986f0-3f20-457f-92c5-c9ad2fedd24a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:44.280155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-df2986f0-3f20-457f-92c5-c9ad2fedd24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:44.316833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e06d9-5459-4167-9de9-38e68ea58e2c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:44.393184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e142225-0d96-4b93-b72f-c31b3e5acc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:44.393785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e142225-0d96-4b93-b72f-c31b3e5acc61 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.394066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e142225-0d96-4b93-b72f-c31b3e5acc61 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.394336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e142225-0d96-4b93-b72f-c31b3e5acc61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.395094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e142225-0d96-4b93-b72f-c31b3e5acc61 None admin] RBAC: Adding query filter params (role.id=2628e24e62034387a031fadb4b6d21a7, scope.project.id=65e5d2374d6d489d9ce0f7c913737262, user.id=18f8b85eb80f4c6a945d78b0675304a0) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:44.397860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e142225-0d96-4b93-b72f-c31b3e5acc61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:44.399372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e142225-0d96-4b93-b72f-c31b3e5acc61 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:44.412120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 57/112] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:44 2022] GET /identity/v3/role_assignments?user.id=18f8b85eb80f4c6a945d78b0675304a0&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=2628e24e62034387a031fadb4b6d21a7 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:44.428069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 56/113] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:44.530549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e142225-0d96-4b93-b72f-c31b3e5acc61 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.574221 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:44.710787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e142225-0d96-4b93-b72f-c31b3e5acc61 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:44.753876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547142-a1b1-478d-8fd4-bf4bc567ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:44.754521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547142-a1b1-478d-8fd4-bf4bc567ded3 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.754843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547142-a1b1-478d-8fd4-bf4bc567ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.755123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547142-a1b1-478d-8fd4-bf4bc567ded3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.767016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74547142-a1b1-478d-8fd4-bf4bc567ded3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:44.769977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3085e65-adb6-4c6f-a1a1-0a6028632033 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.770266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3085e65-adb6-4c6f-a1a1-0a6028632033 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.770540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3085e65-adb6-4c6f-a1a1-0a6028632033 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.772079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 57/114] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-74547142-a1b1-478d-8fd4-bf4bc567ded3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:44.772415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:44.773809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:44.774569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 58/115] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:44.777836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384fcc-e148-473b-92d6-5948ef4b7d93 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.778129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384fcc-e148-473b-92d6-5948ef4b7d93 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.778405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384fcc-e148-473b-92d6-5948ef4b7d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.785310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547142-a1b1-478d-8fd4-bf4bc567ded3 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.816838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-37384fcc-e148-473b-92d6-5948ef4b7d93 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:44.818167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-37384fcc-e148-473b-92d6-5948ef4b7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:44.913924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:44.920246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:44.926568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 58/116] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:44.927450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37384fcc-e148-473b-92d6-5948ef4b7d93 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.942297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547142-a1b1-478d-8fd4-bf4bc567ded3 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:44.979552 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee485547-2c0a-423f-84cc-7712c462ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:44.980532 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee485547-2c0a-423f-84cc-7712c462ec67 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.981034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee485547-2c0a-423f-84cc-7712c462ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.981501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee485547-2c0a-423f-84cc-7712c462ec67 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.982394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee485547-2c0a-423f-84cc-7712c462ec67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:44.982925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee485547-2c0a-423f-84cc-7712c462ec67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:44.984520 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee485547-2c0a-423f-84cc-7712c462ec67 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:44.994640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 59/117] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:45.000561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2eec-63d3-4481-bf3c-5951b7fa94f4 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.001258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2eec-63d3-4481-bf3c-5951b7fa94f4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.001737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2eec-63d3-4481-bf3c-5951b7fa94f4 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.003332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 60/118] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:45.004283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2eec-63d3-4481-bf3c-5951b7fa94f4 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.055734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37384fcc-e148-473b-92d6-5948ef4b7d93 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.104483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88472917-344f-4e4d-878a-32f3677134f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.105141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88472917-344f-4e4d-878a-32f3677134f4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.105423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88472917-344f-4e4d-878a-32f3677134f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.105725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88472917-344f-4e4d-878a-32f3677134f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.121862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88472917-344f-4e4d-878a-32f3677134f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:45.125570 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2eec-63d3-4481-bf3c-5951b7fa94f4 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-88472917-344f-4e4d-878a-32f3677134f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:45.127440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:45.128288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:45.129056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 59/119] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:45.130296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b94d0-8247-4958-9f1f-7bded862fd43 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.130592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b94d0-8247-4958-9f1f-7bded862fd43 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.134954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b94d0-8247-4958-9f1f-7bded862fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.162874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-388b94d0-8247-4958-9f1f-7bded862fd43 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:45.164300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-388b94d0-8247-4958-9f1f-7bded862fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:45.175752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b115b9-d182-442a-b0b2-de69a3644213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.176808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b115b9-d182-442a-b0b2-de69a3644213 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.177288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b115b9-d182-442a-b0b2-de69a3644213 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.177876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b115b9-d182-442a-b0b2-de69a3644213 None admin] PATH_INFO: `/v3/users/046ce058984843509c9c689fc1b1fe83` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.179479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b115b9-d182-442a-b0b2-de69a3644213 None admin] RBAC: Authorizing `identity:get_user(user_id=046ce058984843509c9c689fc1b1fe83)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.181205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b115b9-d182-442a-b0b2-de69a3644213 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.183181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 61/120] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/users/046ce058984843509c9c689fc1b1fe83 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:45.184217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b115b9-d182-442a-b0b2-de69a3644213 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.204722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.228048 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.253964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 60/121] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:45.254739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b94d0-8247-4958-9f1f-7bded862fd43 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.356273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b115b9-d182-442a-b0b2-de69a3644213 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.404111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b49e3-f171-4d5b-97d2-5682547efd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.405529 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b49e3-f171-4d5b-97d2-5682547efd2f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.406010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b49e3-f171-4d5b-97d2-5682547efd2f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.406476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b49e3-f171-4d5b-97d2-5682547efd2f None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.408941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b49e3-f171-4d5b-97d2-5682547efd2f None admin] RBAC: Adding query filter params (name=member) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:45.409460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b49e3-f171-4d5b-97d2-5682547efd2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.411084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b49e3-f171-4d5b-97d2-5682547efd2f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.425148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 62/122] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:45.427300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b49e3-f171-4d5b-97d2-5682547efd2f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.461926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b94d0-8247-4958-9f1f-7bded862fd43 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.541752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.542399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdb415-d20b-4b00-b600-19d9da843203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.543093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdb415-d20b-4b00-b600-19d9da843203 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.543384 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdb415-d20b-4b00-b600-19d9da843203 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.543908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdb415-d20b-4b00-b600-19d9da843203 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.546085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdb415-d20b-4b00-b600-19d9da843203 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.547690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdb415-d20b-4b00-b600-19d9da843203 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.549378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 61/123] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:45.550164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdb415-d20b-4b00-b600-19d9da843203 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.596230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b49e3-f171-4d5b-97d2-5682547efd2f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.625899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.637410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eea09d-a59d-46b5-b89e-84f29b716711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.638345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eea09d-a59d-46b5-b89e-84f29b716711 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.638630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eea09d-a59d-46b5-b89e-84f29b716711 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.639119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eea09d-a59d-46b5-b89e-84f29b716711 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.651922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eea09d-a59d-46b5-b89e-84f29b716711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-74eea09d-a59d-46b5-b89e-84f29b716711 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:45.657319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:45.658238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:45.659037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 63/124] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:45.659699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eea09d-a59d-46b5-b89e-84f29b716711 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.688576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdb415-d20b-4b00-b600-19d9da843203 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.725209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6287f-75fb-443f-af19-e58a03a71f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.726465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6287f-75fb-443f-af19-e58a03a71f2f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.726689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6287f-75fb-443f-af19-e58a03a71f2f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.727095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6287f-75fb-443f-af19-e58a03a71f2f None admin] PATH_INFO: `/v3/users/71a15ac6f0154871b851e8c126489c7b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.728342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6287f-75fb-443f-af19-e58a03a71f2f None admin] RBAC: Authorizing `identity:get_user(user_id=71a15ac6f0154871b851e8c126489c7b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.730160 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6287f-75fb-443f-af19-e58a03a71f2f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.736634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 62/125] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/users/71a15ac6f0154871b851e8c126489c7b => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:45.737824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6287f-75fb-443f-af19-e58a03a71f2f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.776402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eea09d-a59d-46b5-b89e-84f29b716711 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.812897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b05ad-5eac-47a7-beb2-12ded0d10d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.814012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b05ad-5eac-47a7-beb2-12ded0d10d57 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.814548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b05ad-5eac-47a7-beb2-12ded0d10d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.815136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b05ad-5eac-47a7-beb2-12ded0d10d57 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262/users/046ce058984843509c9c689fc1b1fe83/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.817334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b05ad-5eac-47a7-beb2-12ded0d10d57 None admin] RBAC: Authorizing `identity:create_grant(project_id=65e5d2374d6d489d9ce0f7c913737262, user_id=046ce058984843509c9c689fc1b1fe83, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.819044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b05ad-5eac-47a7-beb2-12ded0d10d57 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.836072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 64/126] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:45 2022] PUT /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262/users/046ce058984843509c9c689fc1b1fe83/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:45.836648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.839525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b05ad-5eac-47a7-beb2-12ded0d10d57 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.867999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6287f-75fb-443f-af19-e58a03a71f2f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.910179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.951174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb020d-0c9a-4ab0-ae1c-0eac5ef34b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.952125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb020d-0c9a-4ab0-ae1c-0eac5ef34b71 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.952125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb020d-0c9a-4ab0-ae1c-0eac5ef34b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.952421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb020d-0c9a-4ab0-ae1c-0eac5ef34b71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.981988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b05ad-5eac-47a7-beb2-12ded0d10d57 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.983480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb020d-0c9a-4ab0-ae1c-0eac5ef34b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-12cb020d-0c9a-4ab0-ae1c-0eac5ef34b71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:45.989063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:45.989968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:45.990755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 63/127] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:45.996064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb020d-0c9a-4ab0-ae1c-0eac5ef34b71 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.041780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cad6c-2999-4654-826d-d1d73085edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.042884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cad6c-2999-4654-826d-d1d73085edea None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.043662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cad6c-2999-4654-826d-d1d73085edea None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.044160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cad6c-2999-4654-826d-d1d73085edea None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.045734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cad6c-2999-4654-826d-d1d73085edea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:46.046371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cad6c-2999-4654-826d-d1d73085edea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.048989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cad6c-2999-4654-826d-d1d73085edea None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.064657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 65/128] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.066463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cad6c-2999-4654-826d-d1d73085edea None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.144230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.190421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb020d-0c9a-4ab0-ae1c-0eac5ef34b71 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.210300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cad6c-2999-4654-826d-d1d73085edea None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.237815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c226af-4e7f-4e0b-943e-8b35163cb152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.239019 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c226af-4e7f-4e0b-943e-8b35163cb152 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.239505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c226af-4e7f-4e0b-943e-8b35163cb152 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.240105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c226af-4e7f-4e0b-943e-8b35163cb152 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.242700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c226af-4e7f-4e0b-943e-8b35163cb152 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.244805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c226af-4e7f-4e0b-943e-8b35163cb152 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.246886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 64/129] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.247605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8a1d6-dc34-4eda-b83b-7d5931d1ed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.248075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c226af-4e7f-4e0b-943e-8b35163cb152 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.248472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8a1d6-dc34-4eda-b83b-7d5931d1ed45 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.248823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8a1d6-dc34-4eda-b83b-7d5931d1ed45 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.249171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8a1d6-dc34-4eda-b83b-7d5931d1ed45 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.249913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8a1d6-dc34-4eda-b83b-7d5931d1ed45 None admin] RBAC: Adding query filter params (name=member) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:46.250292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8a1d6-dc34-4eda-b83b-7d5931d1ed45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.252770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8a1d6-dc34-4eda-b83b-7d5931d1ed45 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.262249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 66/130] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.263252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8a1d6-dc34-4eda-b83b-7d5931d1ed45 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.308110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.421956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c226af-4e7f-4e0b-943e-8b35163cb152 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.464239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8a1d6-dc34-4eda-b83b-7d5931d1ed45 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.496297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b97a2-7985-45de-aa12-e3830c561878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.497896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b97a2-7985-45de-aa12-e3830c561878 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.498188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b97a2-7985-45de-aa12-e3830c561878 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.498467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b97a2-7985-45de-aa12-e3830c561878 None admin] PATH_INFO: `/v3/users/71a15ac6f0154871b851e8c126489c7b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.499343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.503581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b97a2-7985-45de-aa12-e3830c561878 None admin] RBAC: Authorizing `identity:get_user(user_id=71a15ac6f0154871b851e8c126489c7b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.505083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b97a2-7985-45de-aa12-e3830c561878 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.506757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 65/131] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/users/71a15ac6f0154871b851e8c126489c7b => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.511674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b97a2-7985-45de-aa12-e3830c561878 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.528971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497091d-b31a-417e-a529-2b46dee019e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.529711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497091d-b31a-417e-a529-2b46dee019e2 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.529990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497091d-b31a-417e-a529-2b46dee019e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.530262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497091d-b31a-417e-a529-2b46dee019e2 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262/users/71a15ac6f0154871b851e8c126489c7b/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.532340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497091d-b31a-417e-a529-2b46dee019e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=65e5d2374d6d489d9ce0f7c913737262, user_id=71a15ac6f0154871b851e8c126489c7b, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.533805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497091d-b31a-417e-a529-2b46dee019e2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.552392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 67/132] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:46 2022] PUT /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262/users/71a15ac6f0154871b851e8c126489c7b/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:46.553327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497091d-b31a-417e-a529-2b46dee019e2 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.683112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b97a2-7985-45de-aa12-e3830c561878 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.687558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497091d-b31a-417e-a529-2b46dee019e2 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.713342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.730610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af2049-80aa-418e-956c-25a44c49174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.731196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af2049-80aa-418e-956c-25a44c49174c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.731478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af2049-80aa-418e-956c-25a44c49174c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.731753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af2049-80aa-418e-956c-25a44c49174c None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.734185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af2049-80aa-418e-956c-25a44c49174c None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.734542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af2049-80aa-418e-956c-25a44c49174c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.742835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 68/133] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.744489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7a396-02eb-41c6-a654-8cae286fa436 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.744891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7a396-02eb-41c6-a654-8cae286fa436 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.745192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7a396-02eb-41c6-a654-8cae286fa436 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.746834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 69/134] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:46.749654 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7a396-02eb-41c6-a654-8cae286fa436 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.770129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa305fc-c759-4718-8334-9496b5203b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.771321 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa305fc-c759-4718-8334-9496b5203b5e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.771748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa305fc-c759-4718-8334-9496b5203b5e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa305fc-c759-4718-8334-9496b5203b5e None admin] PATH_INFO: `/v3/users/71a15ac6f0154871b851e8c126489c7b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.778874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa305fc-c759-4718-8334-9496b5203b5e None admin] RBAC: Authorizing `identity:get_user(user_id=71a15ac6f0154871b851e8c126489c7b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.780754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa305fc-c759-4718-8334-9496b5203b5e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.782688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 66/135] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/users/71a15ac6f0154871b851e8c126489c7b => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.784277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296071a2-e140-41dc-8995-16a77242ffa0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.784708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296071a2-e140-41dc-8995-16a77242ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.785124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296071a2-e140-41dc-8995-16a77242ffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.802261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.833615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-296071a2-e140-41dc-8995-16a77242ffa0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:46.835298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-296071a2-e140-41dc-8995-16a77242ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:46.896947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7a396-02eb-41c6-a654-8cae286fa436 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.920265 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 67/136] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:46.921396 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296071a2-e140-41dc-8995-16a77242ffa0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.941390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95d422-2987-4740-b4c2-52d1857a90c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.942065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95d422-2987-4740-b4c2-52d1857a90c6 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.942346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95d422-2987-4740-b4c2-52d1857a90c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.942635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95d422-2987-4740-b4c2-52d1857a90c6 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262/users/71a15ac6f0154871b851e8c126489c7b/roles/597a1ee9b8e047e4b63712515f4994f0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.945343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95d422-2987-4740-b4c2-52d1857a90c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=65e5d2374d6d489d9ce0f7c913737262, user_id=71a15ac6f0154871b851e8c126489c7b, role_id=597a1ee9b8e047e4b63712515f4994f0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.947236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95d422-2987-4740-b4c2-52d1857a90c6 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.965223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 70/137] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:46 2022] PUT /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262/users/71a15ac6f0154871b851e8c126489c7b/roles/597a1ee9b8e047e4b63712515f4994f0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:33:47.047265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046f482-e736-4103-8ea0-d8c15e56c89a None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.047579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046f482-e736-4103-8ea0-d8c15e56c89a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.047745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046f482-e736-4103-8ea0-d8c15e56c89a None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.051059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 71/138] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:47.055517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f5f2-f341-4a8f-bf88-d1c768df8583 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.055789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f5f2-f341-4a8f-bf88-d1c768df8583 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.056062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f5f2-f341-4a8f-bf88-d1c768df8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.094093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-bce0f5f2-f341-4a8f-bf88-d1c768df8583 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:47.095520 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-bce0f5f2-f341-4a8f-bf88-d1c768df8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:47.121911 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296071a2-e140-41dc-8995-16a77242ffa0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.150557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:47.192342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 72/139] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:47.214088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32665858-e951-44a1-918c-2cee38ebcccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.215042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665858-e951-44a1-918c-2cee38ebcccb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.215495 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665858-e951-44a1-918c-2cee38ebcccb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.215914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665858-e951-44a1-918c-2cee38ebcccb None admin] PATH_INFO: `/v3/projects/8795fc556c9647b7a8942bc680a4bacc` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.219465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32665858-e951-44a1-918c-2cee38ebcccb None admin] RBAC: Authorizing `identity:get_project(project_id=8795fc556c9647b7a8942bc680a4bacc)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.221222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32665858-e951-44a1-918c-2cee38ebcccb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.223496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 68/140] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/projects/8795fc556c9647b7a8942bc680a4bacc => generated 312 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:47.229534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0f5f2-f341-4a8f-bf88-d1c768df8583 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.290705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:47.351195 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0f5f2-f341-4a8f-bf88-d1c768df8583 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.387266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bee3ad-e8b0-40a8-8792-60552eae170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.387941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bee3ad-e8b0-40a8-8792-60552eae170a None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.388216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bee3ad-e8b0-40a8-8792-60552eae170a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.388488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bee3ad-e8b0-40a8-8792-60552eae170a None admin] PATH_INFO: `/v3/projects/8795fc556c9647b7a8942bc680a4bacc/users/71a15ac6f0154871b851e8c126489c7b/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.390506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bee3ad-e8b0-40a8-8792-60552eae170a None admin] RBAC: Authorizing `identity:create_grant(project_id=8795fc556c9647b7a8942bc680a4bacc, user_id=71a15ac6f0154871b851e8c126489c7b, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.391978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bee3ad-e8b0-40a8-8792-60552eae170a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.407514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 73/141] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:47 2022] PUT /identity/v3/projects/8795fc556c9647b7a8942bc680a4bacc/users/71a15ac6f0154871b851e8c126489c7b/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:47.503129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32665858-e951-44a1-918c-2cee38ebcccb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.532750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bee3ad-e8b0-40a8-8792-60552eae170a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.655573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:47.660118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bee3ad-e8b0-40a8-8792-60552eae170a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.701583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6537d-c1cc-4cda-b9ef-2ff593e5460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.702410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6537d-c1cc-4cda-b9ef-2ff593e5460a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.702801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6537d-c1cc-4cda-b9ef-2ff593e5460a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.703403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6537d-c1cc-4cda-b9ef-2ff593e5460a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.712630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32665858-e951-44a1-918c-2cee38ebcccb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.716376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6537d-c1cc-4cda-b9ef-2ff593e5460a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-28a6537d-c1cc-4cda-b9ef-2ff593e5460a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:47.722212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:47.723128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:47.723900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 74/142] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:47.730121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6537d-c1cc-4cda-b9ef-2ff593e5460a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.792930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78cf37-c9ac-4e84-bb9e-fbc2127f8177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.793592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78cf37-c9ac-4e84-bb9e-fbc2127f8177 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.793877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78cf37-c9ac-4e84-bb9e-fbc2127f8177 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.794154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78cf37-c9ac-4e84-bb9e-fbc2127f8177 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.796215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78cf37-c9ac-4e84-bb9e-fbc2127f8177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.797988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78cf37-c9ac-4e84-bb9e-fbc2127f8177 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.799901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 69/143] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:47.806106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78cf37-c9ac-4e84-bb9e-fbc2127f8177 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.846728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6537d-c1cc-4cda-b9ef-2ff593e5460a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.887442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d7a98-7fe8-4a13-b2eb-4d11ebc5f86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.888068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d7a98-7fe8-4a13-b2eb-4d11ebc5f86d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.888342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d7a98-7fe8-4a13-b2eb-4d11ebc5f86d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.888611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d7a98-7fe8-4a13-b2eb-4d11ebc5f86d None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.889288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d7a98-7fe8-4a13-b2eb-4d11ebc5f86d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:47.889589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d7a98-7fe8-4a13-b2eb-4d11ebc5f86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.891482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d7a98-7fe8-4a13-b2eb-4d11ebc5f86d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.899232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:47.906880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 75/144] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:47.908017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d7a98-7fe8-4a13-b2eb-4d11ebc5f86d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.930981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:48.025311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78cf37-c9ac-4e84-bb9e-fbc2127f8177 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.026962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d7a98-7fe8-4a13-b2eb-4d11ebc5f86d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.067368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb678-f2ee-4758-9361-18f7f8d69e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.068119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb678-f2ee-4758-9361-18f7f8d69e3a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.068468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb678-f2ee-4758-9361-18f7f8d69e3a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.068923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb678-f2ee-4758-9361-18f7f8d69e3a None admin] PATH_INFO: `/v3/users/18f8b85eb80f4c6a945d78b0675304a0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.074791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcb678-f2ee-4758-9361-18f7f8d69e3a None admin] RBAC: Authorizing `identity:get_user(user_id=18f8b85eb80f4c6a945d78b0675304a0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:48.074791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcb678-f2ee-4758-9361-18f7f8d69e3a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:48.079106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 76/145] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/users/18f8b85eb80f4c6a945d78b0675304a0 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:48.080546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb678-f2ee-4758-9361-18f7f8d69e3a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:48.143545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dfa94-e794-406e-91e8-2343e1bd7ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.144563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dfa94-e794-406e-91e8-2343e1bd7ae7 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.145042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dfa94-e794-406e-91e8-2343e1bd7ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.145510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dfa94-e794-406e-91e8-2343e1bd7ae7 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.146374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dfa94-e794-406e-91e8-2343e1bd7ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:48.148128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dfa94-e794-406e-91e8-2343e1bd7ae7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:48.205743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 70/146] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:47 2022] POST /identity/v3/users => generated 283 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:48.213970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:48.227499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb678-f2ee-4758-9361-18f7f8d69e3a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.265472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1e2f9-25b0-4f4b-86f3-df16bd8f30ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.266118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1e2f9-25b0-4f4b-86f3-df16bd8f30ea None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.266399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1e2f9-25b0-4f4b-86f3-df16bd8f30ea None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.266675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1e2f9-25b0-4f4b-86f3-df16bd8f30ea None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.267853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1e2f9-25b0-4f4b-86f3-df16bd8f30ea None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:48.269295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1e2f9-25b0-4f4b-86f3-df16bd8f30ea None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:48.271192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 77/147] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:48 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:48.279899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dfa94-e794-406e-91e8-2343e1bd7ae7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:48.376397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4fc7c-682f-444a-a313-b394cbea25f7 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.376709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4fc7c-682f-444a-a313-b394cbea25f7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.376974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4fc7c-682f-444a-a313-b394cbea25f7 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.378561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 78/148] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:48.388310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d291-fd32-46f1-8265-59105a96eb5c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.388627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d291-fd32-46f1-8265-59105a96eb5c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.388878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d291-fd32-46f1-8265-59105a96eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.442967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1023d291-fd32-46f1-8265-59105a96eb5c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:48.449198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1023d291-fd32-46f1-8265-59105a96eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:48.587477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dfa94-e794-406e-91e8-2343e1bd7ae7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.604810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:48.686796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 79/149] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:48.736326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0837b-b57b-4fc3-965b-a99ac7c5868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.737394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0837b-b57b-4fc3-965b-a99ac7c5868b None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.737924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0837b-b57b-4fc3-965b-a99ac7c5868b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.738397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0837b-b57b-4fc3-965b-a99ac7c5868b None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262/users/18f8b85eb80f4c6a945d78b0675304a0/roles/2628e24e62034387a031fadb4b6d21a7` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.750614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0837b-b57b-4fc3-965b-a99ac7c5868b None admin] RBAC: Authorizing `identity:create_grant(project_id=65e5d2374d6d489d9ce0f7c913737262, user_id=18f8b85eb80f4c6a945d78b0675304a0, role_id=2628e24e62034387a031fadb4b6d21a7)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:48.752514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0837b-b57b-4fc3-965b-a99ac7c5868b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:48.783451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 71/150] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:48 2022] PUT /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262/users/18f8b85eb80f4c6a945d78b0675304a0/roles/2628e24e62034387a031fadb4b6d21a7 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:49.130714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023d291-fd32-46f1-8265-59105a96eb5c None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.235673 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:49.254372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023d291-fd32-46f1-8265-59105a96eb5c None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.306758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6862-fa6e-4492-8042-cde2a1a16fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.307439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6862-fa6e-4492-8042-cde2a1a16fe5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.307713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6862-fa6e-4492-8042-cde2a1a16fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.307979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6862-fa6e-4492-8042-cde2a1a16fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.323422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6862-fa6e-4492-8042-cde2a1a16fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-1a3b6862-fa6e-4492-8042-cde2a1a16fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:49.328218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:49.329183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:49.329956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 80/151] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:49.337330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0837b-b57b-4fc3-965b-a99ac7c5868b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.481175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0837b-b57b-4fc3-965b-a99ac7c5868b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.521812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6caaf6-b8ba-4323-b23e-c0b293c73320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.522567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6caaf6-b8ba-4323-b23e-c0b293c73320 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.523006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6caaf6-b8ba-4323-b23e-c0b293c73320 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.523289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6caaf6-b8ba-4323-b23e-c0b293c73320 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.524144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6caaf6-b8ba-4323-b23e-c0b293c73320 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:49.524456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6caaf6-b8ba-4323-b23e-c0b293c73320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:49.525870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6caaf6-b8ba-4323-b23e-c0b293c73320 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:49.539918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 72/152] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:49.545721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6862-fa6e-4492-8042-cde2a1a16fe5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.704137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6862-fa6e-4492-8042-cde2a1a16fe5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.749086 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026e7e-8fbb-45f2-a75e-35c702016835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.749709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026e7e-8fbb-45f2-a75e-35c702016835 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.749992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026e7e-8fbb-45f2-a75e-35c702016835 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.750261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026e7e-8fbb-45f2-a75e-35c702016835 None admin] PATH_INFO: `/v3/users/046ce058984843509c9c689fc1b1fe83` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.751485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026e7e-8fbb-45f2-a75e-35c702016835 None admin] RBAC: Authorizing `identity:get_user(user_id=046ce058984843509c9c689fc1b1fe83)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:49.752945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026e7e-8fbb-45f2-a75e-35c702016835 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:49.755571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 81/153] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:49 2022] GET /identity/v3/users/046ce058984843509c9c689fc1b1fe83 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:49.761796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6caaf6-b8ba-4323-b23e-c0b293c73320 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.762835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1ca0-0be5-40d0-84b8-998d34b3b507 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.763113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1ca0-0be5-40d0-84b8-998d34b3b507 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.763384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1ca0-0be5-40d0-84b8-998d34b3b507 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.764736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 82/154] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:49.770346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eebd8-2010-4f35-8f4f-8b23e39082d0 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.770611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eebd8-2010-4f35-8f4f-8b23e39082d0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.770966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eebd8-2010-4f35-8f4f-8b23e39082d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.804923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0e1eebd8-2010-4f35-8f4f-8b23e39082d0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:49.806130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0e1eebd8-2010-4f35-8f4f-8b23e39082d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:49.827156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:49.832804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:49.965230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 83/155] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:49.972490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6caaf6-b8ba-4323-b23e-c0b293c73320 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:50.020959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f8c8c-b95c-4a14-b9d0-bcac6e934e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:50.021518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f8c8c-b95c-4a14-b9d0-bcac6e934e86 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.021803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f8c8c-b95c-4a14-b9d0-bcac6e934e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.022085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f8c8c-b95c-4a14-b9d0-bcac6e934e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.113523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f8c8c-b95c-4a14-b9d0-bcac6e934e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:50.115072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f8c8c-b95c-4a14-b9d0-bcac6e934e86 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:50.144929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:50.236959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 73/156] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:50.242985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eebd8-2010-4f35-8f4f-8b23e39082d0 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:50.378541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eebd8-2010-4f35-8f4f-8b23e39082d0 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:50.420534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc4a7-2c2c-4993-9fc3-53ec7bd6950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:50.421538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc4a7-2c2c-4993-9fc3-53ec7bd6950a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.421996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc4a7-2c2c-4993-9fc3-53ec7bd6950a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.422455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc4a7-2c2c-4993-9fc3-53ec7bd6950a None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.423802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fc4a7-2c2c-4993-9fc3-53ec7bd6950a None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:50.425520 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fc4a7-2c2c-4993-9fc3-53ec7bd6950a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:50.427768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 84/157] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:50 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:50.433413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f8c8c-b95c-4a14-b9d0-bcac6e934e86 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:50.592843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc4a7-2c2c-4993-9fc3-53ec7bd6950a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:50.597511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f8c8c-b95c-4a14-b9d0-bcac6e934e86 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:50.619654 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:50.643882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:50.674806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2e3f-9b98-415c-b91d-fd74f55fec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:50.675712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2e3f-9b98-415c-b91d-fd74f55fec64 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.676226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2e3f-9b98-415c-b91d-fd74f55fec64 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.676707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2e3f-9b98-415c-b91d-fd74f55fec64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.677831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e2e3f-9b98-415c-b91d-fd74f55fec64 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=65e5d2374d6d489d9ce0f7c913737262, user.id=046ce058984843509c9c689fc1b1fe83) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:50.678353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e2e3f-9b98-415c-b91d-fd74f55fec64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:50.680796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e2e3f-9b98-415c-b91d-fd74f55fec64 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:50.694029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 74/158] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:50 2022] GET /identity/v3/role_assignments?user.id=046ce058984843509c9c689fc1b1fe83&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:50.749416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc4a7-2c2c-4993-9fc3-53ec7bd6950a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:50.789938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acbf2a-14ce-4f4f-80ad-69cb32252a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:50.790589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acbf2a-14ce-4f4f-80ad-69cb32252a34 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.790890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acbf2a-14ce-4f4f-80ad-69cb32252a34 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.791162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acbf2a-14ce-4f4f-80ad-69cb32252a34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.802845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acbf2a-14ce-4f4f-80ad-69cb32252a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-d6acbf2a-14ce-4f4f-80ad-69cb32252a34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:50.808742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:50.809779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:50.810604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:50.814914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 85/159] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:50.816480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2e3f-9b98-415c-b91d-fd74f55fec64 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:50.906091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec596c-86b7-4a5c-a33a-0c1314f1b81d None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.906398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec596c-86b7-4a5c-a33a-0c1314f1b81d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.906558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec596c-86b7-4a5c-a33a-0c1314f1b81d None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.908300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 86/160] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:50.916792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f30b8-5d50-4db9-be0e-48be65852cce None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.917143 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f30b8-5d50-4db9-be0e-48be65852cce None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.917358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f30b8-5d50-4db9-be0e-48be65852cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.951490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5e9f30b8-5d50-4db9-be0e-48be65852cce None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:50.953636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5e9f30b8-5d50-4db9-be0e-48be65852cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:50.995229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2e3f-9b98-415c-b91d-fd74f55fec64 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.060178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.061836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb57e5-8f72-459d-a20b-f7b020f3f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.062629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb57e5-8f72-459d-a20b-f7b020f3f047 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.062843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 87/161] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:51.063009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb57e5-8f72-459d-a20b-f7b020f3f047 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.063329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb57e5-8f72-459d-a20b-f7b020f3f047 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.064040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb57e5-8f72-459d-a20b-f7b020f3f047 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:51.066436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb57e5-8f72-459d-a20b-f7b020f3f047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.067990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb57e5-8f72-459d-a20b-f7b020f3f047 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.089346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 75/162] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:51.094894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f30b8-5d50-4db9-be0e-48be65852cce None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.176320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2949597-cea3-494e-9a8d-9c1d171aee94 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.176619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2949597-cea3-494e-9a8d-9c1d171aee94 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.176900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2949597-cea3-494e-9a8d-9c1d171aee94 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.178525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 76/163] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:51.185073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc36ee2-c1ec-4f02-916d-87d7080ef615 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.185342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc36ee2-c1ec-4f02-916d-87d7080ef615 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.185622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc36ee2-c1ec-4f02-916d-87d7080ef615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.219080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fbc36ee2-c1ec-4f02-916d-87d7080ef615 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:51.220408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fbc36ee2-c1ec-4f02-916d-87d7080ef615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:51.228553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f30b8-5d50-4db9-be0e-48be65852cce None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.264420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26007da1-8588-495f-b003-454e46c7190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.265072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26007da1-8588-495f-b003-454e46c7190b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.265348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26007da1-8588-495f-b003-454e46c7190b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.265659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26007da1-8588-495f-b003-454e46c7190b None admin] PATH_INFO: `/v3/users/71a15ac6f0154871b851e8c126489c7b` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.266890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26007da1-8588-495f-b003-454e46c7190b None admin] RBAC: Authorizing `identity:get_user(user_id=71a15ac6f0154871b851e8c126489c7b)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.268565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26007da1-8588-495f-b003-454e46c7190b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.274940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 88/164] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/users/71a15ac6f0154871b851e8c126489c7b => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:51.277265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26007da1-8588-495f-b003-454e46c7190b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.313777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.359141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.376558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 77/165] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 18 20:33:51.393359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26007da1-8588-495f-b003-454e46c7190b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.431450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef99dc-1e63-41e0-a8e4-b14f070096b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.432137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef99dc-1e63-41e0-a8e4-b14f070096b9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.432480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef99dc-1e63-41e0-a8e4-b14f070096b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.432756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef99dc-1e63-41e0-a8e4-b14f070096b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.504584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef99dc-1e63-41e0-a8e4-b14f070096b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.506057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef99dc-1e63-41e0-a8e4-b14f070096b9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.579215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.596605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc36ee2-c1ec-4f02-916d-87d7080ef615 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.615117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 89/166] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:33:51.624191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef99dc-1e63-41e0-a8e4-b14f070096b9 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.768188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc36ee2-c1ec-4f02-916d-87d7080ef615 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.804323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64638f-eb36-4680-b7f2-73a0a1ee0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.805350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64638f-eb36-4680-b7f2-73a0a1ee0cbc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.805650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64638f-eb36-4680-b7f2-73a0a1ee0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.805919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64638f-eb36-4680-b7f2-73a0a1ee0cbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.817050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64638f-eb36-4680-b7f2-73a0a1ee0cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-da64638f-eb36-4680-b7f2-73a0a1ee0cbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:51.822629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:51.823645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:51.824702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 78/167] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:51.838371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64638f-eb36-4680-b7f2-73a0a1ee0cbc None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.855186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef99dc-1e63-41e0-a8e4-b14f070096b9 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.919137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.926873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7002301-56c1-445f-9b56-6f3e127c77fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.928381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7002301-56c1-445f-9b56-6f3e127c77fb None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.929231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7002301-56c1-445f-9b56-6f3e127c77fb None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.929517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7002301-56c1-445f-9b56-6f3e127c77fb None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.932174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7002301-56c1-445f-9b56-6f3e127c77fb None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.933655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7002301-56c1-445f-9b56-6f3e127c77fb None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.937386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 90/168] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:51.945806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7002301-56c1-445f-9b56-6f3e127c77fb None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.017250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.041453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64638f-eb36-4680-b7f2-73a0a1ee0cbc None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.108830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c329-683e-48af-b46a-02f06db584bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.109457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c329-683e-48af-b46a-02f06db584bb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.109734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c329-683e-48af-b46a-02f06db584bb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.110000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c329-683e-48af-b46a-02f06db584bb None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.110682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c329-683e-48af-b46a-02f06db584bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:52.111015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c329-683e-48af-b46a-02f06db584bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.112424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c329-683e-48af-b46a-02f06db584bb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.122274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7002301-56c1-445f-9b56-6f3e127c77fb None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.126662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 79/169] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:52.127330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c329-683e-48af-b46a-02f06db584bb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.176986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e061af-f52d-4bc3-b37a-9bc1976c21ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.177657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e061af-f52d-4bc3-b37a-9bc1976c21ad None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.177936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e061af-f52d-4bc3-b37a-9bc1976c21ad None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.178286 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e061af-f52d-4bc3-b37a-9bc1976c21ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.179444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e061af-f52d-4bc3-b37a-9bc1976c21ad None admin] RBAC: Adding query filter params (role.id=b7551ed385954688a565792f95efda9c, scope.project.id=65e5d2374d6d489d9ce0f7c913737262, user.id=71a15ac6f0154871b851e8c126489c7b) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:52.179819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e061af-f52d-4bc3-b37a-9bc1976c21ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.181409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e061af-f52d-4bc3-b37a-9bc1976c21ad None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.201157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 91/170] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/role_assignments?user.id=71a15ac6f0154871b851e8c126489c7b&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=b7551ed385954688a565792f95efda9c => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:52.201840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e061af-f52d-4bc3-b37a-9bc1976c21ad None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.299307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c329-683e-48af-b46a-02f06db584bb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.302101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.321204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.326000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e061af-f52d-4bc3-b37a-9bc1976c21ad None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.365714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ea9b3-964c-439f-932a-fbf735dfe05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.366939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea9b3-964c-439f-932a-fbf735dfe05e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.367222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea9b3-964c-439f-932a-fbf735dfe05e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.367499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea9b3-964c-439f-932a-fbf735dfe05e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.369709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edabc4-23de-4280-b30b-f134eabeda03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.370361 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edabc4-23de-4280-b30b-f134eabeda03 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.370639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edabc4-23de-4280-b30b-f134eabeda03 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.370943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edabc4-23de-4280-b30b-f134eabeda03 None admin] PATH_INFO: `/v3/users/71a15ac6f0154871b851e8c126489c7b` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.373366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edabc4-23de-4280-b30b-f134eabeda03 None admin] RBAC: Authorizing `identity:get_user(user_id=71a15ac6f0154871b851e8c126489c7b)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.374882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edabc4-23de-4280-b30b-f134eabeda03 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.376565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 92/171] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/users/71a15ac6f0154871b851e8c126489c7b => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:52.386224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edabc4-23de-4280-b30b-f134eabeda03 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.401917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ea9b3-964c-439f-932a-fbf735dfe05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-297ea9b3-964c-439f-932a-fbf735dfe05e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:52.411148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:52.412109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:52.413095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:52.414494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 80/172] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:52.417981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ea9b3-964c-439f-932a-fbf735dfe05e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.575220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edabc4-23de-4280-b30b-f134eabeda03 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.584561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ea9b3-964c-439f-932a-fbf735dfe05e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.634833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6445f-a640-443f-a741-b4e179460889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.636374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6445f-a640-443f-a741-b4e179460889 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.636825 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6445f-a640-443f-a741-b4e179460889 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.637545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6445f-a640-443f-a741-b4e179460889 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.638484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6445f-a640-443f-a741-b4e179460889 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:52.638984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6445f-a640-443f-a741-b4e179460889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.640567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6445f-a640-443f-a741-b4e179460889 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.644731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64233fa6-c6f7-4d72-919e-75f1b771cfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.645551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233fa6-c6f7-4d72-919e-75f1b771cfc4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.645929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233fa6-c6f7-4d72-919e-75f1b771cfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.646372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233fa6-c6f7-4d72-919e-75f1b771cfc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.655965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 81/173] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:52.658522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0c322-9419-482f-a671-91700c08a3d1 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.663377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0c322-9419-482f-a671-91700c08a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.663881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0c322-9419-482f-a671-91700c08a3d1 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.667057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 82/174] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:52.667979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0c322-9419-482f-a671-91700c08a3d1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.716289 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.721551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.761194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64233fa6-c6f7-4d72-919e-75f1b771cfc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.764287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64233fa6-c6f7-4d72-919e-75f1b771cfc4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.882177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0c322-9419-482f-a671-91700c08a3d1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.896303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 93/175] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:52.898508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c221147-e34f-4c6c-abe0-46f1832ce2ad None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.898749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c221147-e34f-4c6c-abe0-46f1832ce2ad None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.902955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c221147-e34f-4c6c-abe0-46f1832ce2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.922081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1c221147-e34f-4c6c-abe0-46f1832ce2ad None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:52.923306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1c221147-e34f-4c6c-abe0-46f1832ce2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:52.934870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f49f7-5f68-4bd7-bd41-e73fc80fef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.936317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f49f7-5f68-4bd7-bd41-e73fc80fef41 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.936825 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f49f7-5f68-4bd7-bd41-e73fc80fef41 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.937310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f49f7-5f68-4bd7-bd41-e73fc80fef41 None admin] PATH_INFO: `/v3/users/71a15ac6f0154871b851e8c126489c7b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.939023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f49f7-5f68-4bd7-bd41-e73fc80fef41 None admin] RBAC: Authorizing `identity:get_user(user_id=71a15ac6f0154871b851e8c126489c7b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.941441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f49f7-5f68-4bd7-bd41-e73fc80fef41 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.944011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 83/176] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/users/71a15ac6f0154871b851e8c126489c7b => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:52.945939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d321f7c-679e-4dde-ac66-d38656d1ac7c None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.946437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d321f7c-679e-4dde-ac66-d38656d1ac7c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.946963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d321f7c-679e-4dde-ac66-d38656d1ac7c None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.948742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 84/177] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:52.949923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d321f7c-679e-4dde-ac66-d38656d1ac7c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.020692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.032818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 94/178] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:53.034667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c221147-e34f-4c6c-abe0-46f1832ce2ad None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.084658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.105142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d321f7c-679e-4dde-ac66-d38656d1ac7c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.160323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c221147-e34f-4c6c-abe0-46f1832ce2ad None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.179151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a74b22-66cd-4014-994f-145381d55d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.179805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a74b22-66cd-4014-994f-145381d55d87 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.180082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a74b22-66cd-4014-994f-145381d55d87 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.180401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a74b22-66cd-4014-994f-145381d55d87 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.181492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a74b22-66cd-4014-994f-145381d55d87 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:53.183665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a74b22-66cd-4014-994f-145381d55d87 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:53.191532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 85/179] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:53.192897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814919-7b39-4b64-bc18-fca63bc8681c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.193181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814919-7b39-4b64-bc18-fca63bc8681c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.193453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814919-7b39-4b64-bc18-fca63bc8681c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.211866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08ee6e-fa74-4055-9a28-93b6dc4b45b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.212541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ee6e-fa74-4055-9a28-93b6dc4b45b3 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.213962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ee6e-fa74-4055-9a28-93b6dc4b45b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.214245 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ee6e-fa74-4055-9a28-93b6dc4b45b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.239801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f7814919-7b39-4b64-bc18-fca63bc8681c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:53.241541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f7814919-7b39-4b64-bc18-fca63bc8681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:53.329510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.333466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08ee6e-fa74-4055-9a28-93b6dc4b45b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:53.335759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08ee6e-fa74-4055-9a28-93b6dc4b45b3 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:53.364743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 86/180] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:53.366248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7814919-7b39-4b64-bc18-fca63bc8681c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.469986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.483309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7814919-7b39-4b64-bc18-fca63bc8681c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.483460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 95/181] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:53.489116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53d4f-1572-4035-848a-286d8a31e5a4 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.489407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53d4f-1572-4035-848a-286d8a31e5a4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.489683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53d4f-1572-4035-848a-286d8a31e5a4 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.491794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 96/182] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:53.492656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031889-4144-4e0e-901f-9a1aeff3d767 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.492936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031889-4144-4e0e-901f-9a1aeff3d767 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.493206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031889-4144-4e0e-901f-9a1aeff3d767 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.494543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 97/183] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:53.495268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64031889-4144-4e0e-901f-9a1aeff3d767 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.523632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb696373-1e88-4ce0-b917-d876c9acab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.524506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb696373-1e88-4ce0-b917-d876c9acab09 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.524935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb696373-1e88-4ce0-b917-d876c9acab09 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.525374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb696373-1e88-4ce0-b917-d876c9acab09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.526240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb696373-1e88-4ce0-b917-d876c9acab09 None admin] RBAC: Adding query filter params (role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=65e5d2374d6d489d9ce0f7c913737262, user.id=71a15ac6f0154871b851e8c126489c7b) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:53.526694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb696373-1e88-4ce0-b917-d876c9acab09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:53.528303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb696373-1e88-4ce0-b917-d876c9acab09 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:53.535356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 87/184] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/role_assignments?user.id=71a15ac6f0154871b851e8c126489c7b&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:53.536324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb696373-1e88-4ce0-b917-d876c9acab09 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.627666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.635449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64031889-4144-4e0e-901f-9a1aeff3d767 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.676244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb696373-1e88-4ce0-b917-d876c9acab09 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.678101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d084f7-6d8b-4b08-94f3-db84756914a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.679309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d084f7-6d8b-4b08-94f3-db84756914a5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.679584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d084f7-6d8b-4b08-94f3-db84756914a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.680655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d084f7-6d8b-4b08-94f3-db84756914a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.692072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d084f7-6d8b-4b08-94f3-db84756914a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-21d084f7-6d8b-4b08-94f3-db84756914a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:53.697882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:53.699167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:53.699981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 98/185] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:53.700674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7be67-9a7b-4538-bd2d-65403457e846 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.700748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7be67-9a7b-4538-bd2d-65403457e846 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.701276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7be67-9a7b-4538-bd2d-65403457e846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.719934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5cf7be67-9a7b-4538-bd2d-65403457e846 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:53.721208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5cf7be67-9a7b-4538-bd2d-65403457e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:53.727637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0dd67-b04c-47e8-a76c-5caa93b84804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.728279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0dd67-b04c-47e8-a76c-5caa93b84804 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.728559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0dd67-b04c-47e8-a76c-5caa93b84804 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.728830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0dd67-b04c-47e8-a76c-5caa93b84804 None admin] PATH_INFO: `/v3/projects/8795fc556c9647b7a8942bc680a4bacc` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.730450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0dd67-b04c-47e8-a76c-5caa93b84804 None admin] RBAC: Authorizing `identity:get_project(project_id=8795fc556c9647b7a8942bc680a4bacc)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:53.732319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0dd67-b04c-47e8-a76c-5caa93b84804 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:53.734850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 88/186] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/projects/8795fc556c9647b7a8942bc680a4bacc => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:53.735688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0c92-4d1a-4505-9b80-4f43b4624f02 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.735969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0c92-4d1a-4505-9b80-4f43b4624f02 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.736241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0c92-4d1a-4505-9b80-4f43b4624f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.757308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f94e0c92-4d1a-4505-9b80-4f43b4624f02 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:53.759410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f94e0c92-4d1a-4505-9b80-4f43b4624f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:53.781752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.801122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 99/187] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:53.802054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7be67-9a7b-4538-bd2d-65403457e846 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.839752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 89/188] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:53.840435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e0c92-4d1a-4505-9b80-4f43b4624f02 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.917642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.931843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7be67-9a7b-4538-bd2d-65403457e846 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.965201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e0c92-4d1a-4505-9b80-4f43b4624f02 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.978050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf58041-0426-4273-a74e-3f495126577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.979300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf58041-0426-4273-a74e-3f495126577f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.980248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf58041-0426-4273-a74e-3f495126577f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.980735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf58041-0426-4273-a74e-3f495126577f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.996223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf58041-0426-4273-a74e-3f495126577f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:54.001621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445debed-2901-4d0d-83a5-c6a9243f6f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.002239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445debed-2901-4d0d-83a5-c6a9243f6f62 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.002517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445debed-2901-4d0d-83a5-c6a9243f6f62 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.002813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445debed-2901-4d0d-83a5-c6a9243f6f62 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.003530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445debed-2901-4d0d-83a5-c6a9243f6f62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:54.003833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445debed-2901-4d0d-83a5-c6a9243f6f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-bbf58041-0426-4273-a74e-3f495126577f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:54.004293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:54.005243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:54.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:54.006759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445debed-2901-4d0d-83a5-c6a9243f6f62 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.008556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 100/189] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:54.009179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf58041-0426-4273-a74e-3f495126577f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.020978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 90/190] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.026118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445debed-2901-4d0d-83a5-c6a9243f6f62 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.048104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.124828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf58041-0426-4273-a74e-3f495126577f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.146310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445debed-2901-4d0d-83a5-c6a9243f6f62 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.158300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ee222-59a4-48db-86ea-35a3621654d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.158956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ee222-59a4-48db-86ea-35a3621654d4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.159231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ee222-59a4-48db-86ea-35a3621654d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.159504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ee222-59a4-48db-86ea-35a3621654d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.160230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ee222-59a4-48db-86ea-35a3621654d4 None admin] RBAC: Adding query filter params (role.id=b7551ed385954688a565792f95efda9c, scope.project.id=8795fc556c9647b7a8942bc680a4bacc, user.id=71a15ac6f0154871b851e8c126489c7b) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:54.160536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ee222-59a4-48db-86ea-35a3621654d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.161969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ee222-59a4-48db-86ea-35a3621654d4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.169364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 101/191] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/role_assignments?user.id=71a15ac6f0154871b851e8c126489c7b&scope.project.id=8795fc556c9647b7a8942bc680a4bacc&role.id=b7551ed385954688a565792f95efda9c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.170188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ee222-59a4-48db-86ea-35a3621654d4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.183351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166193c-08d8-44aa-87a6-69b768915aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.183985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166193c-08d8-44aa-87a6-69b768915aab None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.184262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166193c-08d8-44aa-87a6-69b768915aab None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.184531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166193c-08d8-44aa-87a6-69b768915aab None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.185216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166193c-08d8-44aa-87a6-69b768915aab None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:54.185519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166193c-08d8-44aa-87a6-69b768915aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.186987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166193c-08d8-44aa-87a6-69b768915aab None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.195573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.196800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 91/192] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.201245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166193c-08d8-44aa-87a6-69b768915aab None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.300406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ee222-59a4-48db-86ea-35a3621654d4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.306955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.339303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166193c-08d8-44aa-87a6-69b768915aab None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.344061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391e1d7-becc-4309-a207-ffec5b3a87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.344703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391e1d7-becc-4309-a207-ffec5b3a87a5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.345798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391e1d7-becc-4309-a207-ffec5b3a87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.345798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391e1d7-becc-4309-a207-ffec5b3a87a5 None admin] PATH_INFO: `/v3/users/18f8b85eb80f4c6a945d78b0675304a0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.346798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391e1d7-becc-4309-a207-ffec5b3a87a5 None admin] RBAC: Authorizing `identity:get_user(user_id=18f8b85eb80f4c6a945d78b0675304a0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.348457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391e1d7-becc-4309-a207-ffec5b3a87a5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.351226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 102/193] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/users/18f8b85eb80f4c6a945d78b0675304a0 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.352352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391e1d7-becc-4309-a207-ffec5b3a87a5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.381156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4257d5-1603-4ce6-b727-f8b4462c53fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.382177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4257d5-1603-4ce6-b727-f8b4462c53fe None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.382796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4257d5-1603-4ce6-b727-f8b4462c53fe None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.383091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4257d5-1603-4ce6-b727-f8b4462c53fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.396719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4257d5-1603-4ce6-b727-f8b4462c53fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ac4257d5-1603-4ce6-b727-f8b4462c53fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:54.403411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:54.404516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 92/194] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:54.405431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4257d5-1603-4ce6-b727-f8b4462c53fe None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.446461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.466715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391e1d7-becc-4309-a207-ffec5b3a87a5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.504276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca391160-2e0c-4f52-b358-d0e651aab3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.504922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca391160-2e0c-4f52-b358-d0e651aab3d6 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.505185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca391160-2e0c-4f52-b358-d0e651aab3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.505451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca391160-2e0c-4f52-b358-d0e651aab3d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.506589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca391160-2e0c-4f52-b358-d0e651aab3d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.508014 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca391160-2e0c-4f52-b358-d0e651aab3d6 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.509014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4257d5-1603-4ce6-b727-f8b4462c53fe None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.509830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 103/195] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.510933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca391160-2e0c-4f52-b358-d0e651aab3d6 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.543961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed6f6-d6a3-49c6-a649-de7e542e307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.544834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed6f6-d6a3-49c6-a649-de7e542e307d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.545151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed6f6-d6a3-49c6-a649-de7e542e307d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.545398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed6f6-d6a3-49c6-a649-de7e542e307d None admin] PATH_INFO: `/v3/users/f4e61564583e48af8fa311f62767ca6b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.548191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.560674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ed6f6-d6a3-49c6-a649-de7e542e307d None admin] RBAC: Authorizing `identity:get_user(user_id=f4e61564583e48af8fa311f62767ca6b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.562030 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ed6f6-d6a3-49c6-a649-de7e542e307d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.563761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 93/196] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/users/f4e61564583e48af8fa311f62767ca6b => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.564525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed6f6-d6a3-49c6-a649-de7e542e307d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.626437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca391160-2e0c-4f52-b358-d0e651aab3d6 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.661376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ffc84-ca20-4a35-9170-cd9eca9e0f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.661982 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ffc84-ca20-4a35-9170-cd9eca9e0f92 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.662267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ffc84-ca20-4a35-9170-cd9eca9e0f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.662535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ffc84-ca20-4a35-9170-cd9eca9e0f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.666532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed6f6-d6a3-49c6-a649-de7e542e307d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.681464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.700197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a885de8-a3ab-4cae-8f8f-073d91076697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.700811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a885de8-a3ab-4cae-8f8f-073d91076697 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.701223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a885de8-a3ab-4cae-8f8f-073d91076697 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.701497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a885de8-a3ab-4cae-8f8f-073d91076697 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.702161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a885de8-a3ab-4cae-8f8f-073d91076697 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:54.702462 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a885de8-a3ab-4cae-8f8f-073d91076697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.703899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a885de8-a3ab-4cae-8f8f-073d91076697 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.712463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 94/197] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.713248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a885de8-a3ab-4cae-8f8f-073d91076697 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.734656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ffc84-ca20-4a35-9170-cd9eca9e0f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.736179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ffc84-ca20-4a35-9170-cd9eca9e0f92 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.770143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.814686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a885de8-a3ab-4cae-8f8f-073d91076697 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.834919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 104/198] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:54.836187 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ffc84-ca20-4a35-9170-cd9eca9e0f92 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.853929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de69e2-0d1c-4fb7-9eb1-5e818a0daf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.854546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de69e2-0d1c-4fb7-9eb1-5e818a0daf14 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.854856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de69e2-0d1c-4fb7-9eb1-5e818a0daf14 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.855125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de69e2-0d1c-4fb7-9eb1-5e818a0daf14 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.855769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de69e2-0d1c-4fb7-9eb1-5e818a0daf14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.857231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de69e2-0d1c-4fb7-9eb1-5e818a0daf14 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.886848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 95/199] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:54 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:54.886848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de69e2-0d1c-4fb7-9eb1-5e818a0daf14 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.901316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.964668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ffc84-ca20-4a35-9170-cd9eca9e0f92 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.999620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de69e2-0d1c-4fb7-9eb1-5e818a0daf14 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.004046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412c9d-4df4-4d4c-84ea-8a0de9310720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.004676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412c9d-4df4-4d4c-84ea-8a0de9310720 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.004952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412c9d-4df4-4d4c-84ea-8a0de9310720 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.005219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412c9d-4df4-4d4c-84ea-8a0de9310720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.014233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.042657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbae91-09a6-4d06-b2a5-d162dcea5a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.043990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbae91-09a6-4d06-b2a5-d162dcea5a78 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.043990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbae91-09a6-4d06-b2a5-d162dcea5a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.043990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbae91-09a6-4d06-b2a5-d162dcea5a78 None admin] PATH_INFO: `/v3/users/f4e61564583e48af8fa311f62767ca6b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.045924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbae91-09a6-4d06-b2a5-d162dcea5a78 None admin] RBAC: Authorizing `identity:get_user(user_id=f4e61564583e48af8fa311f62767ca6b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.047417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbae91-09a6-4d06-b2a5-d162dcea5a78 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.049014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 96/200] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/users/f4e61564583e48af8fa311f62767ca6b => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:55.049767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbae91-09a6-4d06-b2a5-d162dcea5a78 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.095241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea412c9d-4df4-4d4c-84ea-8a0de9310720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.096646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea412c9d-4df4-4d4c-84ea-8a0de9310720 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.166056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.185928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbae91-09a6-4d06-b2a5-d162dcea5a78 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.227470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7df23a-941d-4f02-88db-49722d774bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.228442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7df23a-941d-4f02-88db-49722d774bee None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.228727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7df23a-941d-4f02-88db-49722d774bee None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.229001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7df23a-941d-4f02-88db-49722d774bee None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.230144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7df23a-941d-4f02-88db-49722d774bee None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.231643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7df23a-941d-4f02-88db-49722d774bee None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.232022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 105/201] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:55.232953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412c9d-4df4-4d4c-84ea-8a0de9310720 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.237138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 97/202] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:55.238342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7df23a-941d-4f02-88db-49722d774bee None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.296606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.354554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7df23a-941d-4f02-88db-49722d774bee None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.376855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412c9d-4df4-4d4c-84ea-8a0de9310720 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.391566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ee2ca-be27-4893-935a-480446e846e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.392258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ee2ca-be27-4893-935a-480446e846e4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.392558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ee2ca-be27-4893-935a-480446e846e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.393005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ee2ca-be27-4893-935a-480446e846e4 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.393944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ee2ca-be27-4893-935a-480446e846e4 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.395541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ee2ca-be27-4893-935a-480446e846e4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.397867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 98/203] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:55.398712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ee2ca-be27-4893-935a-480446e846e4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.425021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb600436-2e8f-4bd5-86b9-921bb068948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.426238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600436-2e8f-4bd5-86b9-921bb068948a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.427054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600436-2e8f-4bd5-86b9-921bb068948a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.427339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600436-2e8f-4bd5-86b9-921bb068948a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.452236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.508536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb600436-2e8f-4bd5-86b9-921bb068948a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.510178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb600436-2e8f-4bd5-86b9-921bb068948a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.531210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ee2ca-be27-4893-935a-480446e846e4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.555145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.577478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eac97-b782-436f-aa9e-8f4b4f571441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.578728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eac97-b782-436f-aa9e-8f4b4f571441 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.579600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eac97-b782-436f-aa9e-8f4b4f571441 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.580472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eac97-b782-436f-aa9e-8f4b4f571441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.581678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eac97-b782-436f-aa9e-8f4b4f571441 None admin] RBAC: Adding query filter params (role.id=2628e24e62034387a031fadb4b6d21a7, scope.project.id=65e5d2374d6d489d9ce0f7c913737262, user.id=18f8b85eb80f4c6a945d78b0675304a0) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:55.582406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eac97-b782-436f-aa9e-8f4b4f571441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.584933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eac97-b782-436f-aa9e-8f4b4f571441 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.592324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 99/204] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/role_assignments?user.id=18f8b85eb80f4c6a945d78b0675304a0&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=2628e24e62034387a031fadb4b6d21a7 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:55.593433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eac97-b782-436f-aa9e-8f4b4f571441 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.645193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 106/205] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:55.652929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb600436-2e8f-4bd5-86b9-921bb068948a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.755119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.771516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eac97-b782-436f-aa9e-8f4b4f571441 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.813779 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14629835-26b9-4ccb-acd3-d8206c8b95a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.814400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14629835-26b9-4ccb-acd3-d8206c8b95a0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.814681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14629835-26b9-4ccb-acd3-d8206c8b95a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.815034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14629835-26b9-4ccb-acd3-d8206c8b95a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.815837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14629835-26b9-4ccb-acd3-d8206c8b95a0 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=242f77755a624c91b449fbc88eeae5ef, user.id=f4e61564583e48af8fa311f62767ca6b) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:55.816154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14629835-26b9-4ccb-acd3-d8206c8b95a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.817625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14629835-26b9-4ccb-acd3-d8206c8b95a0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.826077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb600436-2e8f-4bd5-86b9-921bb068948a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.828218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 100/206] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/role_assignments?user.id=f4e61564583e48af8fa311f62767ca6b&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:55.869063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059816-a3d5-48e7-8fa5-54fcafb14bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.869719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059816-a3d5-48e7-8fa5-54fcafb14bd9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.869996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059816-a3d5-48e7-8fa5-54fcafb14bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.870269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059816-a3d5-48e7-8fa5-54fcafb14bd9 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.871441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059816-a3d5-48e7-8fa5-54fcafb14bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.872969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059816-a3d5-48e7-8fa5-54fcafb14bd9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.875016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 107/207] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:55.884194 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14629835-26b9-4ccb-acd3-d8206c8b95a0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.942513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:56.007635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14629835-26b9-4ccb-acd3-d8206c8b95a0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:56.050091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe4809-0bad-43ce-be42-97f599303bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:56.050712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe4809-0bad-43ce-be42-97f599303bef None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:56.051020 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe4809-0bad-43ce-be42-97f599303bef None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:56.051293 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe4809-0bad-43ce-be42-97f599303bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:56.052037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe4809-0bad-43ce-be42-97f599303bef None admin] RBAC: Adding query filter params (role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=242f77755a624c91b449fbc88eeae5ef, user.id=f4e61564583e48af8fa311f62767ca6b) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:56.052344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe4809-0bad-43ce-be42-97f599303bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:56.054363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe4809-0bad-43ce-be42-97f599303bef None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:56.060889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 101/208] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/role_assignments?user.id=f4e61564583e48af8fa311f62767ca6b&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:57.000031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a52dc-4da3-429a-b03e-ddccccfbb051 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.000572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a52dc-4da3-429a-b03e-ddccccfbb051 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.000572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a52dc-4da3-429a-b03e-ddccccfbb051 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.002056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 108/209] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:57.008010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a08dfa-19de-4468-b7fb-4e473194883c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.008804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a08dfa-19de-4468-b7fb-4e473194883c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.008804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a08dfa-19de-4468-b7fb-4e473194883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.028334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-82a08dfa-19de-4468-b7fb-4e473194883c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:57.030068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-82a08dfa-19de-4468-b7fb-4e473194883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:57.119869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce6f56-6e8c-413c-9757-581da398589a None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.120296 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce6f56-6e8c-413c-9757-581da398589a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.120708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce6f56-6e8c-413c-9757-581da398589a None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.122912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 109/210] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:57.129028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 102/211] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:57.134805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9d64e-45f3-402d-9483-e05f5f8eae30 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.134805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9d64e-45f3-402d-9483-e05f5f8eae30 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.134805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9d64e-45f3-402d-9483-e05f5f8eae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.156132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-edc9d64e-45f3-402d-9483-e05f5f8eae30 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:57.157341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-edc9d64e-45f3-402d-9483-e05f5f8eae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:57.228930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 110/212] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:57.409676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a08dfa-19de-4468-b7fb-4e473194883c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:57.458228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:57.526627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a08dfa-19de-4468-b7fb-4e473194883c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:57.547955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9d64e-45f3-402d-9483-e05f5f8eae30 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:57.571425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d18129-68c1-476a-bb91-e16d8ff48821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:57.572546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d18129-68c1-476a-bb91-e16d8ff48821 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.572831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d18129-68c1-476a-bb91-e16d8ff48821 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.573105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d18129-68c1-476a-bb91-e16d8ff48821 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.588244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d18129-68c1-476a-bb91-e16d8ff48821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-99d18129-68c1-476a-bb91-e16d8ff48821 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:57.599944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:57.600874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:57.601670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:33:57.602288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 103/213] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:57.602359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:57.607571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d18129-68c1-476a-bb91-e16d8ff48821 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:57.663682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9d64e-45f3-402d-9483-e05f5f8eae30 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:57.701563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a13e5-3c83-4490-8a89-2633103d6793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:57.702299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a13e5-3c83-4490-8a89-2633103d6793 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.702640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a13e5-3c83-4490-8a89-2633103d6793 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.703000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a13e5-3c83-4490-8a89-2633103d6793 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.704158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a13e5-3c83-4490-8a89-2633103d6793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:57.705784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a13e5-3c83-4490-8a89-2633103d6793 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:57.707663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 111/214] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:57.713454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a13e5-3c83-4490-8a89-2633103d6793 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:57.741865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:57.747665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d18129-68c1-476a-bb91-e16d8ff48821 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:57.783610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035d7ba-1eec-4296-b566-8781978792cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:57.784369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035d7ba-1eec-4296-b566-8781978792cd None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.784666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035d7ba-1eec-4296-b566-8781978792cd None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.784965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035d7ba-1eec-4296-b566-8781978792cd None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.785692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035d7ba-1eec-4296-b566-8781978792cd None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:57.786120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035d7ba-1eec-4296-b566-8781978792cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:57.787598 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035d7ba-1eec-4296-b566-8781978792cd None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:57.802083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 104/215] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:57.803886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035d7ba-1eec-4296-b566-8781978792cd None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:57.832157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a13e5-3c83-4490-8a89-2633103d6793 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:57.852692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:57.877667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85071ae-6422-45bc-a73f-3ec062cc66a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:57.878831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85071ae-6422-45bc-a73f-3ec062cc66a3 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.879564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85071ae-6422-45bc-a73f-3ec062cc66a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.880266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85071ae-6422-45bc-a73f-3ec062cc66a3 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.882048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85071ae-6422-45bc-a73f-3ec062cc66a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:57.884820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85071ae-6422-45bc-a73f-3ec062cc66a3 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:57.920673 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 112/216] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:57 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:57.930856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035d7ba-1eec-4296-b566-8781978792cd None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:57.948401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e88c05-a1cf-47e5-9d98-8d92a2967a41 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.948789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e88c05-a1cf-47e5-9d98-8d92a2967a41 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.949247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e88c05-a1cf-47e5-9d98-8d92a2967a41 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.952288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 113/217] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:57.956907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23eeeb-b2e8-44d5-ae19-e3e22d70fb17 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.957267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23eeeb-b2e8-44d5-ae19-e3e22d70fb17 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.957609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23eeeb-b2e8-44d5-ae19-e3e22d70fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.978212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0d23eeeb-b2e8-44d5-ae19-e3e22d70fb17 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:57.978482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3075-9e59-4bc0-a2b2-3b54f9c72019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:57.979380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3075-9e59-4bc0-a2b2-3b54f9c72019 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.979715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0d23eeeb-b2e8-44d5-ae19-e3e22d70fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:57.979965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3075-9e59-4bc0-a2b2-3b54f9c72019 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.980534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3075-9e59-4bc0-a2b2-3b54f9c72019 None admin] PATH_INFO: `/v3/users/d333d75a9c054964abb6ce625c421b99` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.997395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f3075-9e59-4bc0-a2b2-3b54f9c72019 None admin] RBAC: Authorizing `identity:get_user(user_id=d333d75a9c054964abb6ce625c421b99)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:57.999196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f3075-9e59-4bc0-a2b2-3b54f9c72019 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:58.001550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 105/218] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:57 2022] GET /identity/v3/users/d333d75a9c054964abb6ce625c421b99 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:58.008123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3075-9e59-4bc0-a2b2-3b54f9c72019 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:58.034279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:58.067000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 114/219] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:58.068407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62055d1c-74e3-4e42-bc86-803e283579b4 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:58.068688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62055d1c-74e3-4e42-bc86-803e283579b4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:58.069504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62055d1c-74e3-4e42-bc86-803e283579b4 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:58.071201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 115/220] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:58.076944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7fa4-8003-4214-be68-2df623f1bfed None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:58.077222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7fa4-8003-4214-be68-2df623f1bfed None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:58.077496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7fa4-8003-4214-be68-2df623f1bfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:58.099188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-fc1e7fa4-8003-4214-be68-2df623f1bfed None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:58.100441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-fc1e7fa4-8003-4214-be68-2df623f1bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:58.136946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3075-9e59-4bc0-a2b2-3b54f9c72019 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:58.195706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76558841-baa4-469e-b146-ee92fa31e945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:58.196618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76558841-baa4-469e-b146-ee92fa31e945 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:58.197028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76558841-baa4-469e-b146-ee92fa31e945 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:58.197440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76558841-baa4-469e-b146-ee92fa31e945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:58.203858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 116/221] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:58.283334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76558841-baa4-469e-b146-ee92fa31e945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:58.284811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76558841-baa4-469e-b146-ee92fa31e945 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:58.308444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:58.337098 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e7fa4-8003-4214-be68-2df623f1bfed None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:58.384358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:58.414966 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 106/222] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:58.424332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76558841-baa4-469e-b146-ee92fa31e945 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:58.468399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e7fa4-8003-4214-be68-2df623f1bfed None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:58.533342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8ba11-298a-47e2-8218-c842f761a3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:58.534792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8ba11-298a-47e2-8218-c842f761a3b1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:58.535564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8ba11-298a-47e2-8218-c842f761a3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:58.536032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8ba11-298a-47e2-8218-c842f761a3b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:58.551689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8ba11-298a-47e2-8218-c842f761a3b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:58.558677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76558841-baa4-469e-b146-ee92fa31e945 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-29b8ba11-298a-47e2-8218-c842f761a3b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:58.559284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:58.560169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:58.560968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:58.564387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 117/223] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:58.565363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8ba11-298a-47e2-8218-c842f761a3b1 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:58.580622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:58.603635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb9d3e-bdb3-4918-8f2f-cef1f91482a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:58.604681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb9d3e-bdb3-4918-8f2f-cef1f91482a3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:58.604897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb9d3e-bdb3-4918-8f2f-cef1f91482a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:58.605256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb9d3e-bdb3-4918-8f2f-cef1f91482a3 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:58.606554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb9d3e-bdb3-4918-8f2f-cef1f91482a3 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:58.608238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb9d3e-bdb3-4918-8f2f-cef1f91482a3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:58.610498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 107/224] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:58 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:58.611520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb9d3e-bdb3-4918-8f2f-cef1f91482a3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:58.681344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:58.692763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8ba11-298a-47e2-8218-c842f761a3b1 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:58.734219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dbb3e-1616-4487-8659-97babff230df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:58.735436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dbb3e-1616-4487-8659-97babff230df None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:58.735813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dbb3e-1616-4487-8659-97babff230df None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:58.736449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dbb3e-1616-4487-8659-97babff230df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:58.748856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb9d3e-bdb3-4918-8f2f-cef1f91482a3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:58.752221 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dbb3e-1616-4487-8659-97babff230df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4f2dbb3e-1616-4487-8659-97babff230df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:58.757697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:58.758924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:58.759739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:33:58.762084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 118/225] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:58.763146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dbb3e-1616-4487-8659-97babff230df None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:58.793758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81c9d-e474-431c-8526-d41d0939658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:58.794388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81c9d-e474-431c-8526-d41d0939658b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:58.794676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81c9d-e474-431c-8526-d41d0939658b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:58.794999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81c9d-e474-431c-8526-d41d0939658b None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:58.795858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a81c9d-e474-431c-8526-d41d0939658b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:58.796164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a81c9d-e474-431c-8526-d41d0939658b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:58.798012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a81c9d-e474-431c-8526-d41d0939658b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:58.809593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 108/226] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:58.810465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81c9d-e474-431c-8526-d41d0939658b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:58.877628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:58.883553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dbb3e-1616-4487-8659-97babff230df None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:58.926048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b3a4-f29a-45dd-a797-519d5e66e352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:58.927762 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b3a4-f29a-45dd-a797-519d5e66e352 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:58.928059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b3a4-f29a-45dd-a797-519d5e66e352 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:58.928373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b3a4-f29a-45dd-a797-519d5e66e352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:58.929981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9b3a4-f29a-45dd-a797-519d5e66e352 None admin] RBAC: Adding query filter params (role.id=b7551ed385954688a565792f95efda9c, scope.project.id=242f77755a624c91b449fbc88eeae5ef, user.id=d333d75a9c054964abb6ce625c421b99) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:58.930300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9b3a4-f29a-45dd-a797-519d5e66e352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:58.932074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9b3a4-f29a-45dd-a797-519d5e66e352 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:58.939998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 119/227] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:58 2022] GET /identity/v3/role_assignments?user.id=d333d75a9c054964abb6ce625c421b99&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=b7551ed385954688a565792f95efda9c => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:58.941270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b3a4-f29a-45dd-a797-519d5e66e352 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:58.950660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81c9d-e474-431c-8526-d41d0939658b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:58.965254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:59.029306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ed38-921c-408b-abfd-81d8a87eb6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:59.030630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ed38-921c-408b-abfd-81d8a87eb6bd None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.031240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ed38-921c-408b-abfd-81d8a87eb6bd None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.031741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ed38-921c-408b-abfd-81d8a87eb6bd None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.032907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883ed38-921c-408b-abfd-81d8a87eb6bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:59.033532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883ed38-921c-408b-abfd-81d8a87eb6bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:59.036471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883ed38-921c-408b-abfd-81d8a87eb6bd None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:59.059002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 109/228] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:59.064136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ed38-921c-408b-abfd-81d8a87eb6bd None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:59.163668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b3a4-f29a-45dd-a797-519d5e66e352 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:59.184161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ed38-921c-408b-abfd-81d8a87eb6bd None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:59.207128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:59.245087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fe3b2-19e4-4fe5-8c60-6579aac00ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:59.245744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fe3b2-19e4-4fe5-8c60-6579aac00ccc None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.246023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fe3b2-19e4-4fe5-8c60-6579aac00ccc None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.246294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fe3b2-19e4-4fe5-8c60-6579aac00ccc None admin] PATH_INFO: `/v3/users/f4e61564583e48af8fa311f62767ca6b` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.248147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fe3b2-19e4-4fe5-8c60-6579aac00ccc None admin] RBAC: Authorizing `identity:get_user(user_id=f4e61564583e48af8fa311f62767ca6b)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:59.249626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fe3b2-19e4-4fe5-8c60-6579aac00ccc None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:59.251449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 120/229] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:58 2022] GET /identity/v3/users/f4e61564583e48af8fa311f62767ca6b => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:59.255361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3acc5-a8ab-41d5-bd1a-e1e04639ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:59.256009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3acc5-a8ab-41d5-bd1a-e1e04639ec97 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.256297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3acc5-a8ab-41d5-bd1a-e1e04639ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.257119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3acc5-a8ab-41d5-bd1a-e1e04639ec97 None admin] PATH_INFO: `/v3/users/f4e61564583e48af8fa311f62767ca6b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.259207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fe3b2-19e4-4fe5-8c60-6579aac00ccc None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:59.262324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3acc5-a8ab-41d5-bd1a-e1e04639ec97 None admin] RBAC: Authorizing `identity:get_user(user_id=f4e61564583e48af8fa311f62767ca6b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:59.263834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3acc5-a8ab-41d5-bd1a-e1e04639ec97 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:59.265456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 110/230] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:59 2022] GET /identity/v3/users/f4e61564583e48af8fa311f62767ca6b => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:59.275559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3acc5-a8ab-41d5-bd1a-e1e04639ec97 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:59.405872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:59.431449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fe3b2-19e4-4fe5-8c60-6579aac00ccc None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:59.473732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3acc5-a8ab-41d5-bd1a-e1e04639ec97 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:59.490089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bef9a-72c5-4504-afed-570a8465ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:59.490969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bef9a-72c5-4504-afed-570a8465ac1b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.491134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bef9a-72c5-4504-afed-570a8465ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.491508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bef9a-72c5-4504-afed-570a8465ac1b None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.492925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bef9a-72c5-4504-afed-570a8465ac1b None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:59.494393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bef9a-72c5-4504-afed-570a8465ac1b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:59.496130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 121/231] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:59 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:59.501969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bef9a-72c5-4504-afed-570a8465ac1b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:59.517130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a96d5-c5df-4c50-9f3c-c9552419d68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:59.518302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a96d5-c5df-4c50-9f3c-c9552419d68a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.518840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a96d5-c5df-4c50-9f3c-c9552419d68a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.519346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a96d5-c5df-4c50-9f3c-c9552419d68a None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.520955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a96d5-c5df-4c50-9f3c-c9552419d68a None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:59.523251 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a96d5-c5df-4c50-9f3c-c9552419d68a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:59.525334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 111/232] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:59 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:59.532782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a96d5-c5df-4c50-9f3c-c9552419d68a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:59.627801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bef9a-72c5-4504-afed-570a8465ac1b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:59.629960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:59.668188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fac5b-7851-4db1-ad9b-df41a997e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:59.669084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fac5b-7851-4db1-ad9b-df41a997e942 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.669792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fac5b-7851-4db1-ad9b-df41a997e942 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.670215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fac5b-7851-4db1-ad9b-df41a997e942 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef/users/f4e61564583e48af8fa311f62767ca6b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.674728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fac5b-7851-4db1-ad9b-df41a997e942 None admin] RBAC: Authorizing `identity:create_grant(project_id=242f77755a624c91b449fbc88eeae5ef, user_id=f4e61564583e48af8fa311f62767ca6b, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:59.676531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fac5b-7851-4db1-ad9b-df41a997e942 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:59.702920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 122/233] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:59 2022] PUT /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef/users/f4e61564583e48af8fa311f62767ca6b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:59.740707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a96d5-c5df-4c50-9f3c-c9552419d68a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:59.780143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b820-7104-4de6-84a7-2f78f48732ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:59.781087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b820-7104-4de6-84a7-2f78f48732ed None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.781655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b820-7104-4de6-84a7-2f78f48732ed None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.782074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b820-7104-4de6-84a7-2f78f48732ed None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef/users/f4e61564583e48af8fa311f62767ca6b/roles/597a1ee9b8e047e4b63712515f4994f0` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.784599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b820-7104-4de6-84a7-2f78f48732ed None admin] RBAC: Authorizing `identity:create_grant(project_id=242f77755a624c91b449fbc88eeae5ef, user_id=f4e61564583e48af8fa311f62767ca6b, role_id=597a1ee9b8e047e4b63712515f4994f0)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:59.786269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b820-7104-4de6-84a7-2f78f48732ed None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:59.801374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 112/234] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:59 2022] PUT /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef/users/f4e61564583e48af8fa311f62767ca6b/roles/597a1ee9b8e047e4b63712515f4994f0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:00.539583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593fb69-1bf3-49df-8056-f5e4bfefbf13 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.540107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593fb69-1bf3-49df-8056-f5e4bfefbf13 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.540107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593fb69-1bf3-49df-8056-f5e4bfefbf13 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.541466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 123/235] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:00.546965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662de9-8f1f-4168-bbb5-8d478d70a5db None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.547430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662de9-8f1f-4168-bbb5-8d478d70a5db None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.547522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662de9-8f1f-4168-bbb5-8d478d70a5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.576064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ab662de9-8f1f-4168-bbb5-8d478d70a5db None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:00.577266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ab662de9-8f1f-4168-bbb5-8d478d70a5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:00.627252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cab7f-a9c5-4cdd-8a3a-0c390b2c392d None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.628019 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cab7f-a9c5-4cdd-8a3a-0c390b2c392d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.628916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cab7f-a9c5-4cdd-8a3a-0c390b2c392d None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.630754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 124/236] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:00.637665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f3c76-3407-459f-97a1-928807f025d7 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.637858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f3c76-3407-459f-97a1-928807f025d7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.638051 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f3c76-3407-459f-97a1-928807f025d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.673557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 113/237] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:00.682280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0f1f3c76-3407-459f-97a1-928807f025d7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:00.683837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0f1f3c76-3407-459f-97a1-928807f025d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:00.688150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:00.774498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 125/238] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:01.024522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662de9-8f1f-4168-bbb5-8d478d70a5db None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.067338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:01.101318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f3c76-3407-459f-97a1-928807f025d7 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.150318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662de9-8f1f-4168-bbb5-8d478d70a5db None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.222157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c388d9-69ab-4cdf-9a0a-1d17f65e2d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.223182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c388d9-69ab-4cdf-9a0a-1d17f65e2d13 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.226089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c388d9-69ab-4cdf-9a0a-1d17f65e2d13 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.226606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c388d9-69ab-4cdf-9a0a-1d17f65e2d13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.250606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c388d9-69ab-4cdf-9a0a-1d17f65e2d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-b5c388d9-69ab-4cdf-9a0a-1d17f65e2d13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:01.256960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:01.257835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:01.258943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:01.269377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 114/239] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:01.273866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c388d9-69ab-4cdf-9a0a-1d17f65e2d13 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.338858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f3c76-3407-459f-97a1-928807f025d7 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.382267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bd0eb-5b6a-4973-9add-2ad5f7cdebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.382944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bd0eb-5b6a-4973-9add-2ad5f7cdebdc None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.383225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bd0eb-5b6a-4973-9add-2ad5f7cdebdc None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.383749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bd0eb-5b6a-4973-9add-2ad5f7cdebdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.384960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bd0eb-5b6a-4973-9add-2ad5f7cdebdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.387103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bd0eb-5b6a-4973-9add-2ad5f7cdebdc None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.389313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 126/240] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:01.393972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc507596-fa58-48ba-a9d7-b82837586412 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.393972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc507596-fa58-48ba-a9d7-b82837586412 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.393972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc507596-fa58-48ba-a9d7-b82837586412 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.394909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 127/241] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:01.395604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc507596-fa58-48ba-a9d7-b82837586412 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.413495 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:01.429394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:01.440384 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c388d9-69ab-4cdf-9a0a-1d17f65e2d13 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.488458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51184e18-70dc-454c-b45a-ea60ef8c9e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.489476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51184e18-70dc-454c-b45a-ea60ef8c9e77 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.489957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51184e18-70dc-454c-b45a-ea60ef8c9e77 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.491674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51184e18-70dc-454c-b45a-ea60ef8c9e77 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.492975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51184e18-70dc-454c-b45a-ea60ef8c9e77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:01.493784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51184e18-70dc-454c-b45a-ea60ef8c9e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.495830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51184e18-70dc-454c-b45a-ea60ef8c9e77 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.509043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 115/242] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:01.511022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979d93-f933-4f6e-8312-b006c75f9397 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.511311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979d93-f933-4f6e-8312-b006c75f9397 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.511649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979d93-f933-4f6e-8312-b006c75f9397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.522865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc507596-fa58-48ba-a9d7-b82837586412 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.530328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-cd979d93-f933-4f6e-8312-b006c75f9397 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:01.531735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cd979d93-f933-4f6e-8312-b006c75f9397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:01.573650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad3a50-8d4c-436e-97a3-f0f6816ef3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.574322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad3a50-8d4c-436e-97a3-f0f6816ef3ff None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.574645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad3a50-8d4c-436e-97a3-f0f6816ef3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.575241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad3a50-8d4c-436e-97a3-f0f6816ef3ff None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.576119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad3a50-8d4c-436e-97a3-f0f6816ef3ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.577999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad3a50-8d4c-436e-97a3-f0f6816ef3ff None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.608740 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 128/243] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:01 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:01.610107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad3a50-8d4c-436e-97a3-f0f6816ef3ff None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.644749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 116/244] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:01.723562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:01.785029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad3a50-8d4c-436e-97a3-f0f6816ef3ff None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.821932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56998b7-3c91-4cde-ba71-422281f30ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.822583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56998b7-3c91-4cde-ba71-422281f30ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.822888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56998b7-3c91-4cde-ba71-422281f30ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.823167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56998b7-3c91-4cde-ba71-422281f30ca5 None admin] PATH_INFO: `/v3/users/3bcbd6b68bac4645b67a8ea756bc97a8` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.840360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56998b7-3c91-4cde-ba71-422281f30ca5 None admin] RBAC: Authorizing `identity:get_user(user_id=3bcbd6b68bac4645b67a8ea756bc97a8)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.841832 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56998b7-3c91-4cde-ba71-422281f30ca5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.843563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 129/245] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:01 2022] GET /identity/v3/users/3bcbd6b68bac4645b67a8ea756bc97a8 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:01.849414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd979d93-f933-4f6e-8312-b006c75f9397 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.950302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:01.966274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd979d93-f933-4f6e-8312-b006c75f9397 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.005695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caf2e3-4007-432c-8e56-ad9c03f6df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.006356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caf2e3-4007-432c-8e56-ad9c03f6df43 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.006748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caf2e3-4007-432c-8e56-ad9c03f6df43 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.007065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caf2e3-4007-432c-8e56-ad9c03f6df43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.013958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56998b7-3c91-4cde-ba71-422281f30ca5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.093076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caf2e3-4007-432c-8e56-ad9c03f6df43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:02.094625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caf2e3-4007-432c-8e56-ad9c03f6df43 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:02.159673 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56998b7-3c91-4cde-ba71-422281f30ca5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.188354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:02.203841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960dd03-b20c-4270-bc33-3c14e44650fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.204490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960dd03-b20c-4270-bc33-3c14e44650fd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.204769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960dd03-b20c-4270-bc33-3c14e44650fd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.205040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960dd03-b20c-4270-bc33-3c14e44650fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.206069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:02.217820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960dd03-b20c-4270-bc33-3c14e44650fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4960dd03-b20c-4270-bc33-3c14e44650fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:02.222692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:02.223690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:02.225256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 130/246] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:02.226791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 117/247] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:02.226791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7fc8-4841-4ccc-950d-3f0a6548d7c3 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.226791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7fc8-4841-4ccc-950d-3f0a6548d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.226978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7579a2f-a999-4960-900e-d72cf1a04a10 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.227059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7fc8-4841-4ccc-950d-3f0a6548d7c3 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.227512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7579a2f-a999-4960-900e-d72cf1a04a10 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.227512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7579a2f-a999-4960-900e-d72cf1a04a10 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.228119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 131/248] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:02.231670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7579a2f-a999-4960-900e-d72cf1a04a10 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.232416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 118/249] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:02.233563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba7fc8-4841-4ccc-950d-3f0a6548d7c3 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.352012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7579a2f-a999-4960-900e-d72cf1a04a10 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.389185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba7fc8-4841-4ccc-950d-3f0a6548d7c3 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.389374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9742515-197f-4437-9ac8-9b267bb09e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.389902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9742515-197f-4437-9ac8-9b267bb09e2c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.390184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9742515-197f-4437-9ac8-9b267bb09e2c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.390452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9742515-197f-4437-9ac8-9b267bb09e2c None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.391163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9742515-197f-4437-9ac8-9b267bb09e2c None admin] RBAC: Adding query filter params (name=member) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:02.391463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9742515-197f-4437-9ac8-9b267bb09e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:02.392862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9742515-197f-4437-9ac8-9b267bb09e2c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:02.402240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 132/250] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:02.403780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c053b1-2853-4f87-ad8e-a106e3136053 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.403892 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c053b1-2853-4f87-ad8e-a106e3136053 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.404116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c053b1-2853-4f87-ad8e-a106e3136053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.423172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-72c053b1-2853-4f87-ad8e-a106e3136053 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:02.424301 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-72c053b1-2853-4f87-ad8e-a106e3136053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:02.436572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4204f-64a9-4b7a-9f14-84f119633593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.437998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4204f-64a9-4b7a-9f14-84f119633593 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.438593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4204f-64a9-4b7a-9f14-84f119633593 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.439151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4204f-64a9-4b7a-9f14-84f119633593 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.440670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4204f-64a9-4b7a-9f14-84f119633593 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:02.443002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4204f-64a9-4b7a-9f14-84f119633593 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:02.446236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 119/251] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:02 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:02.447750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd992dd-7d5f-4b02-9ba0-e89875fd2360 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.448242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd992dd-7d5f-4b02-9ba0-e89875fd2360 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.448740 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd992dd-7d5f-4b02-9ba0-e89875fd2360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.471950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2cd992dd-7d5f-4b02-9ba0-e89875fd2360 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:02.473508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2cd992dd-7d5f-4b02-9ba0-e89875fd2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:02.476157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:02.509001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 133/252] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:02.510084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c053b1-2853-4f87-ad8e-a106e3136053 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.543394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:02.587108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 120/253] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:02.587992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd992dd-7d5f-4b02-9ba0-e89875fd2360 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.650876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c053b1-2853-4f87-ad8e-a106e3136053 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.690271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb54630-e5f4-4a77-a3b4-8da0212b1cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.691403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb54630-e5f4-4a77-a3b4-8da0212b1cb6 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.691940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb54630-e5f4-4a77-a3b4-8da0212b1cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.692415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb54630-e5f4-4a77-a3b4-8da0212b1cb6 None admin] PATH_INFO: `/v3/users/d333d75a9c054964abb6ce625c421b99` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.694100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb54630-e5f4-4a77-a3b4-8da0212b1cb6 None admin] RBAC: Authorizing `identity:get_user(user_id=d333d75a9c054964abb6ce625c421b99)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:02.696310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb54630-e5f4-4a77-a3b4-8da0212b1cb6 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:02.698268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 134/254] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:02 2022] GET /identity/v3/users/d333d75a9c054964abb6ce625c421b99 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:02.706968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb54630-e5f4-4a77-a3b4-8da0212b1cb6 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.759954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd992dd-7d5f-4b02-9ba0-e89875fd2360 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.816794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc555c0-d7d0-4e86-9bb9-1ea361f2218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.817781 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc555c0-d7d0-4e86-9bb9-1ea361f2218a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.819044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc555c0-d7d0-4e86-9bb9-1ea361f2218a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.819796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc555c0-d7d0-4e86-9bb9-1ea361f2218a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.822329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc555c0-d7d0-4e86-9bb9-1ea361f2218a None admin] RBAC: Adding query filter params (role.id=2628e24e62034387a031fadb4b6d21a7, scope.project.id=242f77755a624c91b449fbc88eeae5ef, user.id=3bcbd6b68bac4645b67a8ea756bc97a8) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:02.823150 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc555c0-d7d0-4e86-9bb9-1ea361f2218a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:02.825316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc555c0-d7d0-4e86-9bb9-1ea361f2218a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:02.825865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:02.842150 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 121/255] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:02 2022] GET /identity/v3/role_assignments?user.id=3bcbd6b68bac4645b67a8ea756bc97a8&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=2628e24e62034387a031fadb4b6d21a7 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:02.898952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb54630-e5f4-4a77-a3b4-8da0212b1cb6 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.937305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89804e-45e1-4b95-ba37-7dc1be06ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.938374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89804e-45e1-4b95-ba37-7dc1be06ed40 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.938899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89804e-45e1-4b95-ba37-7dc1be06ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.939372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89804e-45e1-4b95-ba37-7dc1be06ed40 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.940799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89804e-45e1-4b95-ba37-7dc1be06ed40 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:02.942519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89804e-45e1-4b95-ba37-7dc1be06ed40 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:02.945797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 135/256] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:02 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:02.951213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc555c0-d7d0-4e86-9bb9-1ea361f2218a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.996066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89804e-45e1-4b95-ba37-7dc1be06ed40 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:03.048452 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:03.123588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc555c0-d7d0-4e86-9bb9-1ea361f2218a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:03.172852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18af5c5-52a3-4f63-9757-97e46dab6bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:03.173529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18af5c5-52a3-4f63-9757-97e46dab6bf3 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.173807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18af5c5-52a3-4f63-9757-97e46dab6bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.174082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18af5c5-52a3-4f63-9757-97e46dab6bf3 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef/users/d333d75a9c054964abb6ce625c421b99/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.177357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18af5c5-52a3-4f63-9757-97e46dab6bf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=242f77755a624c91b449fbc88eeae5ef, user_id=d333d75a9c054964abb6ce625c421b99, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:03.178882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18af5c5-52a3-4f63-9757-97e46dab6bf3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:03.201007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 122/257] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:02 2022] PUT /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef/users/d333d75a9c054964abb6ce625c421b99/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:03.201753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18af5c5-52a3-4f63-9757-97e46dab6bf3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:03.253603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89804e-45e1-4b95-ba37-7dc1be06ed40 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:03.282388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:03.341921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e60d0-d1ab-416f-b014-41314ed23ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:03.342569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e60d0-d1ab-416f-b014-41314ed23ecd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.342869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e60d0-d1ab-416f-b014-41314ed23ecd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.343144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e60d0-d1ab-416f-b014-41314ed23ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.371765 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e60d0-d1ab-416f-b014-41314ed23ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-691e60d0-d1ab-416f-b014-41314ed23ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:03.376766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:03.377646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:03.378451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:03.382717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 136/258] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:03.383957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e60d0-d1ab-416f-b014-41314ed23ecd None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:03.399206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18af5c5-52a3-4f63-9757-97e46dab6bf3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:03.411431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:03.446390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ac619-4f78-4c34-a389-1d158e1ba21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:03.447122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ac619-4f78-4c34-a389-1d158e1ba21a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.447415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ac619-4f78-4c34-a389-1d158e1ba21a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.447693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ac619-4f78-4c34-a389-1d158e1ba21a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.469434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ac619-4f78-4c34-a389-1d158e1ba21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-cb4ac619-4f78-4c34-a389-1d158e1ba21a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:03.476799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:03.477785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:03.478606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:03.481646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 123/259] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:03.487816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ac619-4f78-4c34-a389-1d158e1ba21a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:03.565645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e60d0-d1ab-416f-b014-41314ed23ecd None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:03.602255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ac619-4f78-4c34-a389-1d158e1ba21a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:03.623608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7af52-b12d-4d8e-9f5d-1de3ad7701ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:03.624144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7af52-b12d-4d8e-9f5d-1de3ad7701ce None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.624426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7af52-b12d-4d8e-9f5d-1de3ad7701ce None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.624705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7af52-b12d-4d8e-9f5d-1de3ad7701ce None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.625386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7af52-b12d-4d8e-9f5d-1de3ad7701ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:03.625695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7af52-b12d-4d8e-9f5d-1de3ad7701ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:03.627185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7af52-b12d-4d8e-9f5d-1de3ad7701ce None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:03.636781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 137/260] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:03.642223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7af52-b12d-4d8e-9f5d-1de3ad7701ce None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:03.644408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98208b22-114b-4ffc-a62a-63ff19cfbc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:03.645247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98208b22-114b-4ffc-a62a-63ff19cfbc98 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.645717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98208b22-114b-4ffc-a62a-63ff19cfbc98 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.646201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98208b22-114b-4ffc-a62a-63ff19cfbc98 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.647627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98208b22-114b-4ffc-a62a-63ff19cfbc98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:03.648137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98208b22-114b-4ffc-a62a-63ff19cfbc98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:03.649790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98208b22-114b-4ffc-a62a-63ff19cfbc98 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:03.659136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 124/261] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:03.664970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98208b22-114b-4ffc-a62a-63ff19cfbc98 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:03.698106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:03.700119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:03.822581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7af52-b12d-4d8e-9f5d-1de3ad7701ce None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:03.824710 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98208b22-114b-4ffc-a62a-63ff19cfbc98 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:03.880778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d6652-bccc-4c92-a801-a246ecbffcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:03.882508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d6652-bccc-4c92-a801-a246ecbffcb2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.883011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d6652-bccc-4c92-a801-a246ecbffcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.883727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d6652-bccc-4c92-a801-a246ecbffcb2 None admin] PATH_INFO: `/v3/users/f4e61564583e48af8fa311f62767ca6b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.885117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d6652-bccc-4c92-a801-a246ecbffcb2 None admin] RBAC: Authorizing `identity:get_user(user_id=f4e61564583e48af8fa311f62767ca6b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:03.886836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d6652-bccc-4c92-a801-a246ecbffcb2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:03.888434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd889a62-9ae8-46d9-8eb9-ebc927706cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:03.889191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889a62-9ae8-46d9-8eb9-ebc927706cf5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.889387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889a62-9ae8-46d9-8eb9-ebc927706cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.889634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889a62-9ae8-46d9-8eb9-ebc927706cf5 None admin] PATH_INFO: `/v3/users/f4e61564583e48af8fa311f62767ca6b` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.889978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 125/262] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:03 2022] GET /identity/v3/users/f4e61564583e48af8fa311f62767ca6b => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:03.894674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd889a62-9ae8-46d9-8eb9-ebc927706cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=f4e61564583e48af8fa311f62767ca6b)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:03.896259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd889a62-9ae8-46d9-8eb9-ebc927706cf5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:03.897818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d6652-bccc-4c92-a801-a246ecbffcb2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:03.898604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 138/263] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:03 2022] GET /identity/v3/users/f4e61564583e48af8fa311f62767ca6b => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:03.904051 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd889a62-9ae8-46d9-8eb9-ebc927706cf5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.003428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.007922 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d6652-bccc-4c92-a801-a246ecbffcb2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.045200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb2239-6d08-4576-a63d-90630a605ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.046184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2239-6d08-4576-a63d-90630a605ed8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.047157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2239-6d08-4576-a63d-90630a605ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.047644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2239-6d08-4576-a63d-90630a605ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.083976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.096415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd889a62-9ae8-46d9-8eb9-ebc927706cf5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.123746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb2239-6d08-4576-a63d-90630a605ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.125560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb2239-6d08-4576-a63d-90630a605ed8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.221171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecc7b9-bf43-467c-9550-9969027be672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.221844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecc7b9-bf43-467c-9550-9969027be672 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.222126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecc7b9-bf43-467c-9550-9969027be672 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.222398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecc7b9-bf43-467c-9550-9969027be672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.238798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.240263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 126/264] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:04.242666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb2239-6d08-4576-a63d-90630a605ed8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.354825 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb2239-6d08-4576-a63d-90630a605ed8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.396441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e896e0d-e508-4202-8366-7daa84e69c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.397476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e896e0d-e508-4202-8366-7daa84e69c99 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.397950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e896e0d-e508-4202-8366-7daa84e69c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.398433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e896e0d-e508-4202-8366-7daa84e69c99 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.400277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e896e0d-e508-4202-8366-7daa84e69c99 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.402094 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e896e0d-e508-4202-8366-7daa84e69c99 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.404255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 127/265] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:04.405582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45d49b-a8f8-4f6d-97fe-d95ecbb35fe6 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.410567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45d49b-a8f8-4f6d-97fe-d95ecbb35fe6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.411637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45d49b-a8f8-4f6d-97fe-d95ecbb35fe6 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.413544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 128/266] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:04.414551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45d49b-a8f8-4f6d-97fe-d95ecbb35fe6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.415649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecc7b9-bf43-467c-9550-9969027be672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.417215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecc7b9-bf43-467c-9550-9969027be672 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.501609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.543556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45d49b-a8f8-4f6d-97fe-d95ecbb35fe6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.580439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153bdd0-ca1a-4863-a0cd-0917268f1b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.581100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153bdd0-ca1a-4863-a0cd-0917268f1b5f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.581383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153bdd0-ca1a-4863-a0cd-0917268f1b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.581656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153bdd0-ca1a-4863-a0cd-0917268f1b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.582394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153bdd0-ca1a-4863-a0cd-0917268f1b5f None admin] RBAC: Adding query filter params (role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=242f77755a624c91b449fbc88eeae5ef, user.id=f4e61564583e48af8fa311f62767ca6b) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:04.582704 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153bdd0-ca1a-4863-a0cd-0917268f1b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.584650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153bdd0-ca1a-4863-a0cd-0917268f1b5f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.591874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 129/267] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/role_assignments?user.id=f4e61564583e48af8fa311f62767ca6b&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:04.593136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766df0b-ac64-417b-8762-86d744b1d762 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.593136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766df0b-ac64-417b-8762-86d744b1d762 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.593136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766df0b-ac64-417b-8762-86d744b1d762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.614618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d766df0b-ac64-417b-8762-86d744b1d762 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:04.616659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d766df0b-ac64-417b-8762-86d744b1d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:04.696807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 139/268] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 793 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:34:04.697515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.704028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecc7b9-bf43-467c-9550-9969027be672 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.789801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 130/269] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:04.862123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65145a-549a-42f3-bbee-8d418ce8c32f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.862821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65145a-549a-42f3-bbee-8d418ce8c32f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.862821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65145a-549a-42f3-bbee-8d418ce8c32f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.864151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 131/270] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:04.871066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede735c-64b9-4cae-a1e1-957d309a6c1c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.871312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede735c-64b9-4cae-a1e1-957d309a6c1c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.871536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede735c-64b9-4cae-a1e1-957d309a6c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.892435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecc7b9-bf43-467c-9550-9969027be672 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.927782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-eede735c-64b9-4cae-a1e1-957d309a6c1c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:04.929522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-eede735c-64b9-4cae-a1e1-957d309a6c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:04.930610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff5e92-fc7f-4782-bad6-38577373d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.931515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff5e92-fc7f-4782-bad6-38577373d3ea None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.932030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff5e92-fc7f-4782-bad6-38577373d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.932493 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff5e92-fc7f-4782-bad6-38577373d3ea None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.933875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff5e92-fc7f-4782-bad6-38577373d3ea None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.935765 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff5e92-fc7f-4782-bad6-38577373d3ea None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.937946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 140/271] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:04.943416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff5e92-fc7f-4782-bad6-38577373d3ea None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.027318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.047865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 132/272] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:05.058663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.104939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff5e92-fc7f-4782-bad6-38577373d3ea None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.113128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede735c-64b9-4cae-a1e1-957d309a6c1c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.174509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae2d51-5730-492e-8e84-35bd25935af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.175069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae2d51-5730-492e-8e84-35bd25935af0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.175341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae2d51-5730-492e-8e84-35bd25935af0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.175604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae2d51-5730-492e-8e84-35bd25935af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.176330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae2d51-5730-492e-8e84-35bd25935af0 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=242f77755a624c91b449fbc88eeae5ef, user.id=f4e61564583e48af8fa311f62767ca6b) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:05.176629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae2d51-5730-492e-8e84-35bd25935af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.178596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae2d51-5730-492e-8e84-35bd25935af0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.197013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 141/273] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/role_assignments?user.id=f4e61564583e48af8fa311f62767ca6b&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:05.262725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede735c-64b9-4cae-a1e1-957d309a6c1c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.300093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4caa35-94b4-44d2-8811-58185557ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.300737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4caa35-94b4-44d2-8811-58185557ed9c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.301011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4caa35-94b4-44d2-8811-58185557ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.301280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4caa35-94b4-44d2-8811-58185557ed9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.302379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4caa35-94b4-44d2-8811-58185557ed9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.304236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4caa35-94b4-44d2-8811-58185557ed9c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.306227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 133/274] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:05.312017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae2d51-5730-492e-8e84-35bd25935af0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.377510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4caa35-94b4-44d2-8811-58185557ed9c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.477200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.499853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae2d51-5730-492e-8e84-35bd25935af0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.532775 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4caa35-94b4-44d2-8811-58185557ed9c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.534542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.548413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a875d-aee4-4c1a-b147-f9ccf7120212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.549046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a875d-aee4-4c1a-b147-f9ccf7120212 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.549328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a875d-aee4-4c1a-b147-f9ccf7120212 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.549602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a875d-aee4-4c1a-b147-f9ccf7120212 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.550445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a875d-aee4-4c1a-b147-f9ccf7120212 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.551751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a875d-aee4-4c1a-b147-f9ccf7120212 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.587062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 142/275] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:05 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:05.600649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51467-8677-4460-868e-172595096b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.601591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51467-8677-4460-868e-172595096b62 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.602045 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51467-8677-4460-868e-172595096b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.602459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51467-8677-4460-868e-172595096b62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.606420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1022ed5-46f7-4c34-a2e6-2cecfd046eff None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.606710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1022ed5-46f7-4c34-a2e6-2cecfd046eff None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.607035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1022ed5-46f7-4c34-a2e6-2cecfd046eff None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.608884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 143/276] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:05.614691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdf80d-69a6-4c81-984e-207dba61cc5e None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.615029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdf80d-69a6-4c81-984e-207dba61cc5e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.615306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdf80d-69a6-4c81-984e-207dba61cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.624623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b51467-8677-4460-868e-172595096b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-54b51467-8677-4460-868e-172595096b62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:05.630719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:05.631809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:05.632732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:05.635954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 134/277] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:05.637850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-86cdf80d-69a6-4c81-984e-207dba61cc5e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:05.639895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-86cdf80d-69a6-4c81-984e-207dba61cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:05.641731 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51467-8677-4460-868e-172595096b62 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.734561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 144/278] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:05.789977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51467-8677-4460-868e-172595096b62 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.812570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.829251 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dad078-b503-4195-abbd-c3b69a59813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.829876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dad078-b503-4195-abbd-c3b69a59813e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.830161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dad078-b503-4195-abbd-c3b69a59813e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.830436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dad078-b503-4195-abbd-c3b69a59813e None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.831142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dad078-b503-4195-abbd-c3b69a59813e None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:05.831453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dad078-b503-4195-abbd-c3b69a59813e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.832889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dad078-b503-4195-abbd-c3b69a59813e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.842726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 135/279] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:05.848550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdf80d-69a6-4c81-984e-207dba61cc5e None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.969078 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdf80d-69a6-4c81-984e-207dba61cc5e None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.990403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.012801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b13f-6041-4ebc-9a44-7ac9043fb251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.014485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b13f-6041-4ebc-9a44-7ac9043fb251 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.014869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dad078-b503-4195-abbd-c3b69a59813e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.015695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b13f-6041-4ebc-9a44-7ac9043fb251 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.015983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b13f-6041-4ebc-9a44-7ac9043fb251 None admin] PATH_INFO: `/v3/users/57af589b8b964c49a3828726262cff58` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.038303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31b13f-6041-4ebc-9a44-7ac9043fb251 None admin] RBAC: Authorizing `identity:get_user(user_id=57af589b8b964c49a3828726262cff58)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.040365 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31b13f-6041-4ebc-9a44-7ac9043fb251 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.047648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 145/280] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/users/57af589b8b964c49a3828726262cff58 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:06.051803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b13f-6041-4ebc-9a44-7ac9043fb251 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.148051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dad078-b503-4195-abbd-c3b69a59813e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.191654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08c1d2-e592-43a1-9b2c-cd89a3f9fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.192301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08c1d2-e592-43a1-9b2c-cd89a3f9fff0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.192588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08c1d2-e592-43a1-9b2c-cd89a3f9fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.193015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08c1d2-e592-43a1-9b2c-cd89a3f9fff0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.207877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08c1d2-e592-43a1-9b2c-cd89a3f9fff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2a08c1d2-e592-43a1-9b2c-cd89a3f9fff0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:06.215357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:06.216274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:06.217058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 136/281] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:06.218820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8482-c8b8-4127-b58d-665fcf528be8 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.218820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8482-c8b8-4127-b58d-665fcf528be8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.218820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8482-c8b8-4127-b58d-665fcf528be8 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.220118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 137/282] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:06.222798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b13f-6041-4ebc-9a44-7ac9043fb251 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.225725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8482-c8b8-4127-b58d-665fcf528be8 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.267443 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7f8b8-dfec-4b5b-8bad-67f678cb789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.267984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f8b8-dfec-4b5b-8bad-67f678cb789f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.268261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f8b8-dfec-4b5b-8bad-67f678cb789f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.268527 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f8b8-dfec-4b5b-8bad-67f678cb789f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.269261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7f8b8-dfec-4b5b-8bad-67f678cb789f None admin] RBAC: Adding query filter params (role.id=b7551ed385954688a565792f95efda9c, user.id=57af589b8b964c49a3828726262cff58, scope.system=all) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:06.269566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7f8b8-dfec-4b5b-8bad-67f678cb789f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.271022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7f8b8-dfec-4b5b-8bad-67f678cb789f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.280663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 146/283] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/role_assignments?user.id=57af589b8b964c49a3828726262cff58&scope.system=all&role.id=b7551ed385954688a565792f95efda9c => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:06.289441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470902b0-7d8f-43ff-b723-dcb956d52ed0 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.289738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470902b0-7d8f-43ff-b723-dcb956d52ed0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.290023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470902b0-7d8f-43ff-b723-dcb956d52ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.294661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.325099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-470902b0-7d8f-43ff-b723-dcb956d52ed0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:06.326159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-470902b0-7d8f-43ff-b723-dcb956d52ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:06.366930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8482-c8b8-4127-b58d-665fcf528be8 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.405947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.422657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fca21-d267-4014-ad42-7d7403386b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.423347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fca21-d267-4014-ad42-7d7403386b2a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.424732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fca21-d267-4014-ad42-7d7403386b2a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.424917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fca21-d267-4014-ad42-7d7403386b2a None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.425645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fca21-d267-4014-ad42-7d7403386b2a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:06.425958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fca21-d267-4014-ad42-7d7403386b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.427434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fca21-d267-4014-ad42-7d7403386b2a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.447228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 138/284] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:06.453854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fca21-d267-4014-ad42-7d7403386b2a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.475252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 147/285] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:06.577567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fca21-d267-4014-ad42-7d7403386b2a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.580531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.626347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1e7ff-0a18-46cf-ae8e-ca8cd6577790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.627045 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1e7ff-0a18-46cf-ae8e-ca8cd6577790 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.627325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1e7ff-0a18-46cf-ae8e-ca8cd6577790 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.627597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1e7ff-0a18-46cf-ae8e-ca8cd6577790 None admin] PATH_INFO: `/v3/users/3bcbd6b68bac4645b67a8ea756bc97a8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.628749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1e7ff-0a18-46cf-ae8e-ca8cd6577790 None admin] RBAC: Authorizing `identity:get_user(user_id=3bcbd6b68bac4645b67a8ea756bc97a8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.630218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1e7ff-0a18-46cf-ae8e-ca8cd6577790 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.631918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 139/286] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/users/3bcbd6b68bac4645b67a8ea756bc97a8 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:06.637725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470902b0-7d8f-43ff-b723-dcb956d52ed0 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.785593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470902b0-7d8f-43ff-b723-dcb956d52ed0 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.827847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1e7ff-0a18-46cf-ae8e-ca8cd6577790 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.837270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74017f63-3dc7-4c45-aa22-df8c0e404861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.838333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017f63-3dc7-4c45-aa22-df8c0e404861 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.838872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017f63-3dc7-4c45-aa22-df8c0e404861 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.839349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017f63-3dc7-4c45-aa22-df8c0e404861 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.843440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74017f63-3dc7-4c45-aa22-df8c0e404861 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.845109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74017f63-3dc7-4c45-aa22-df8c0e404861 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.846997 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 148/287] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:06.853247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74017f63-3dc7-4c45-aa22-df8c0e404861 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.906112 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.972476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74017f63-3dc7-4c45-aa22-df8c0e404861 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.017583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe113526-7249-4e06-b178-a527f5fbcd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.018250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe113526-7249-4e06-b178-a527f5fbcd38 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.018522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe113526-7249-4e06-b178-a527f5fbcd38 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.018818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe113526-7249-4e06-b178-a527f5fbcd38 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef/users/3bcbd6b68bac4645b67a8ea756bc97a8/roles/2628e24e62034387a031fadb4b6d21a7` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.024133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe113526-7249-4e06-b178-a527f5fbcd38 None admin] RBAC: Authorizing `identity:create_grant(project_id=242f77755a624c91b449fbc88eeae5ef, user_id=3bcbd6b68bac4645b67a8ea756bc97a8, role_id=2628e24e62034387a031fadb4b6d21a7)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.025576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe113526-7249-4e06-b178-a527f5fbcd38 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.051057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 149/288] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:06 2022] PUT /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef/users/3bcbd6b68bac4645b67a8ea756bc97a8/roles/2628e24e62034387a031fadb4b6d21a7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:34:07.067497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1e7ff-0a18-46cf-ae8e-ca8cd6577790 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.118333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3389-d208-46ed-8066-57c8d73c4f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.118927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3389-d208-46ed-8066-57c8d73c4f61 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.119207 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3389-d208-46ed-8066-57c8d73c4f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.119481 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3389-d208-46ed-8066-57c8d73c4f61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.139334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c3389-d208-46ed-8066-57c8d73c4f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-658c3389-d208-46ed-8066-57c8d73c4f61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:07.144722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:07.145631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:07.146437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 140/289] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:07.152592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe113526-7249-4e06-b178-a527f5fbcd38 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.290341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.297059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe113526-7249-4e06-b178-a527f5fbcd38 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.342577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68757c5-4f53-415c-9b01-565d46c6d42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.343246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68757c5-4f53-415c-9b01-565d46c6d42a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.343525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68757c5-4f53-415c-9b01-565d46c6d42a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.343799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68757c5-4f53-415c-9b01-565d46c6d42a None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.344477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68757c5-4f53-415c-9b01-565d46c6d42a None admin] RBAC: Adding query filter params (name=member) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:07.344778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68757c5-4f53-415c-9b01-565d46c6d42a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.346151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68757c5-4f53-415c-9b01-565d46c6d42a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.356580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 150/290] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:07.363919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3389-d208-46ed-8066-57c8d73c4f61 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.410076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.488192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3389-d208-46ed-8066-57c8d73c4f61 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.527638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624c89e-502a-4618-a39f-5cee12c38e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.528281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624c89e-502a-4618-a39f-5cee12c38e73 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.528561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624c89e-502a-4618-a39f-5cee12c38e73 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.528833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624c89e-502a-4618-a39f-5cee12c38e73 None admin] PATH_INFO: `/v3/users/d333d75a9c054964abb6ce625c421b99` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.529972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624c89e-502a-4618-a39f-5cee12c38e73 None admin] RBAC: Authorizing `identity:get_user(user_id=d333d75a9c054964abb6ce625c421b99)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.531501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624c89e-502a-4618-a39f-5cee12c38e73 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.533541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 141/291] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/users/d333d75a9c054964abb6ce625c421b99 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:07.544140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68757c5-4f53-415c-9b01-565d46c6d42a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.707185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68757c5-4f53-415c-9b01-565d46c6d42a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.761077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55329220-48af-4e84-ab7d-e7d5dc22f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.761937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55329220-48af-4e84-ab7d-e7d5dc22f587 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.762389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55329220-48af-4e84-ab7d-e7d5dc22f587 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.762838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55329220-48af-4e84-ab7d-e7d5dc22f587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.798417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.851025 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55329220-48af-4e84-ab7d-e7d5dc22f587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.852965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55329220-48af-4e84-ab7d-e7d5dc22f587 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.968363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 151/292] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:07.979177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624c89e-502a-4618-a39f-5cee12c38e73 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.068358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a03f06-615a-42cb-9e5f-869c0021bb0b None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.069271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a03f06-615a-42cb-9e5f-869c0021bb0b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.069476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a03f06-615a-42cb-9e5f-869c0021bb0b None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.070858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 152/293] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:08.076139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83dfd-585f-4b3d-b64f-97155ca1168a None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.076819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83dfd-585f-4b3d-b64f-97155ca1168a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.077404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83dfd-585f-4b3d-b64f-97155ca1168a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.108857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e9e83dfd-585f-4b3d-b64f-97155ca1168a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:08.110797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e9e83dfd-585f-4b3d-b64f-97155ca1168a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:08.144061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.151622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624c89e-502a-4618-a39f-5cee12c38e73 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.191507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc902a5-37e0-4a54-9650-803ff3b86945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.192330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc902a5-37e0-4a54-9650-803ff3b86945 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.192618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc902a5-37e0-4a54-9650-803ff3b86945 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.192884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc902a5-37e0-4a54-9650-803ff3b86945 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.194857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc902a5-37e0-4a54-9650-803ff3b86945 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.196388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc902a5-37e0-4a54-9650-803ff3b86945 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.199640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 142/294] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:08.211776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc902a5-37e0-4a54-9650-803ff3b86945 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.242132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.273501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 153/295] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:08.328273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc902a5-37e0-4a54-9650-803ff3b86945 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.369158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ec18d-e1ca-477c-92e8-6f4a1b41fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.370730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ec18d-e1ca-477c-92e8-6f4a1b41fab1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.371635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ec18d-e1ca-477c-92e8-6f4a1b41fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.372196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ec18d-e1ca-477c-92e8-6f4a1b41fab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.373213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ec18d-e1ca-477c-92e8-6f4a1b41fab1 None admin] RBAC: Adding query filter params (role.id=b7551ed385954688a565792f95efda9c, scope.project.id=242f77755a624c91b449fbc88eeae5ef, user.id=d333d75a9c054964abb6ce625c421b99) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:08.373468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd6d18-88b6-44f8-8de8-202f211b65be None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.373757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd6d18-88b6-44f8-8de8-202f211b65be None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.374028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd6d18-88b6-44f8-8de8-202f211b65be None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.374784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ec18d-e1ca-477c-92e8-6f4a1b41fab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.375994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 154/296] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:08.377865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ec18d-e1ca-477c-92e8-6f4a1b41fab1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.381800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d66ed-4d00-44b3-b906-8831f0c51de2 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.381972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d66ed-4d00-44b3-b906-8831f0c51de2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.382258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d66ed-4d00-44b3-b906-8831f0c51de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.390065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 143/297] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/role_assignments?user.id=d333d75a9c054964abb6ce625c421b99&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=b7551ed385954688a565792f95efda9c => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:08.431917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-026d66ed-4d00-44b3-b906-8831f0c51de2 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:08.433146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-026d66ed-4d00-44b3-b906-8831f0c51de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:08.541347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 155/298] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:08.631845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ec18d-e1ca-477c-92e8-6f4a1b41fab1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.677214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.781089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ec18d-e1ca-477c-92e8-6f4a1b41fab1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.826279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f601d-9633-4f3d-9453-caac4219d8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.827299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f601d-9633-4f3d-9453-caac4219d8dc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.827778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f601d-9633-4f3d-9453-caac4219d8dc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.828246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f601d-9633-4f3d-9453-caac4219d8dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.837486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d66ed-4d00-44b3-b906-8831f0c51de2 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.843936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f601d-9633-4f3d-9453-caac4219d8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-be0f601d-9633-4f3d-9453-caac4219d8dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:08.849509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:08.851322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:08.852134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:08.857686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 144/299] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:08.857686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a2c4-c35a-4876-8a2e-3005c328138d None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.857686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a2c4-c35a-4876-8a2e-3005c328138d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.857686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a2c4-c35a-4876-8a2e-3005c328138d None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.857686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 145/300] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:08.858758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8a2c4-c35a-4876-8a2e-3005c328138d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.963033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d66ed-4d00-44b3-b906-8831f0c51de2 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.964626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.978415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8a2c4-c35a-4876-8a2e-3005c328138d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.984114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.999419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925326c9-b74e-4829-8e17-3daa4a848bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.000053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925326c9-b74e-4829-8e17-3daa4a848bdb None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.000326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925326c9-b74e-4829-8e17-3daa4a848bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.000592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925326c9-b74e-4829-8e17-3daa4a848bdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.001707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925326c9-b74e-4829-8e17-3daa4a848bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.003152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925326c9-b74e-4829-8e17-3daa4a848bdb None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.010001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 156/301] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:09.010001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ee596-bddc-494f-880a-cedb6e3fe834 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.010001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ee596-bddc-494f-880a-cedb6e3fe834 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.010001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ee596-bddc-494f-880a-cedb6e3fe834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.023686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa48a4-8825-4eb6-a062-b22ed3825347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.024203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa48a4-8825-4eb6-a062-b22ed3825347 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.024487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa48a4-8825-4eb6-a062-b22ed3825347 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.024742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa48a4-8825-4eb6-a062-b22ed3825347 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.025420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa48a4-8825-4eb6-a062-b22ed3825347 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:09.025728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa48a4-8825-4eb6-a062-b22ed3825347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.025822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-524ee596-bddc-494f-880a-cedb6e3fe834 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:09.027012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-524ee596-bddc-494f-880a-cedb6e3fe834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:09.027232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa48a4-8825-4eb6-a062-b22ed3825347 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.042374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 146/302] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:09.042374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa48a4-8825-4eb6-a062-b22ed3825347 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.108903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 157/303] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:09.109676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ee596-bddc-494f-880a-cedb6e3fe834 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.177915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa48a4-8825-4eb6-a062-b22ed3825347 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:09.219721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ee596-bddc-494f-880a-cedb6e3fe834 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:09.229144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdc924-24ca-4dca-97d2-359bbd6ffe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.231249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc924-24ca-4dca-97d2-359bbd6ffe40 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.232161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc924-24ca-4dca-97d2-359bbd6ffe40 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.232784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc924-24ca-4dca-97d2-359bbd6ffe40 None admin] PATH_INFO: `/v3/groups` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.233986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdc924-24ca-4dca-97d2-359bbd6ffe40 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.236382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdc924-24ca-4dca-97d2-359bbd6ffe40 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.239676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:09.261798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8bea-9fa5-4076-9e9c-6eec2385e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.267349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8bea-9fa5-4076-9e9c-6eec2385e32c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.267349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8bea-9fa5-4076-9e9c-6eec2385e32c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.267349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8bea-9fa5-4076-9e9c-6eec2385e32c None admin] PATH_INFO: `/v3/users/b2fedfbf621041c2bac99651f8183f31` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.267671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 147/304] 10.222.0.65 () {60 vars in 1134 bytes} [Thu Aug 18 20:34:09 2022] POST /identity/v3/groups => generated 229 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:09.285002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff8bea-9fa5-4076-9e9c-6eec2385e32c None admin] RBAC: Authorizing `identity:get_user(user_id=b2fedfbf621041c2bac99651f8183f31)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.286537 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff8bea-9fa5-4076-9e9c-6eec2385e32c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.288539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 158/305] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:09 2022] GET /identity/v3/users/b2fedfbf621041c2bac99651f8183f31 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:09.294841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdc924-24ca-4dca-97d2-359bbd6ffe40 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.330408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:09.387902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8bea-9fa5-4076-9e9c-6eec2385e32c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.412956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdc924-24ca-4dca-97d2-359bbd6ffe40 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:09.450901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac01970-8d59-4331-886c-f62982c86d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.451515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac01970-8d59-4331-886c-f62982c86d6d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.451789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac01970-8d59-4331-886c-f62982c86d6d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.452060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac01970-8d59-4331-886c-f62982c86d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.452811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac01970-8d59-4331-886c-f62982c86d6d None admin] RBAC: Adding query filter params (role.id=2628e24e62034387a031fadb4b6d21a7, user.id=b2fedfbf621041c2bac99651f8183f31, scope.system=all) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:09.453112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac01970-8d59-4331-886c-f62982c86d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.454712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac01970-8d59-4331-886c-f62982c86d6d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.463391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 148/306] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Aug 18 20:34:09 2022] GET /identity/v3/role_assignments?user.id=b2fedfbf621041c2bac99651f8183f31&scope.system=all&role.id=2628e24e62034387a031fadb4b6d21a7 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:09.515211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8bea-9fa5-4076-9e9c-6eec2385e32c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:09.524707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e27c-35fc-4cb7-8954-f2cbdc7cc189 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.525035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e27c-35fc-4cb7-8954-f2cbdc7cc189 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.525261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e27c-35fc-4cb7-8954-f2cbdc7cc189 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.526954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 149/307] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:09.532499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1942-dcf5-49ff-ba3e-052068160f71 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.532804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1942-dcf5-49ff-ba3e-052068160f71 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.533052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1942-dcf5-49ff-ba3e-052068160f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.558930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-900c1942-dcf5-49ff-ba3e-052068160f71 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:09.560181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-900c1942-dcf5-49ff-ba3e-052068160f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:09.566686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a30df-d6de-445d-bb4e-35f673ac2c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.567805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a30df-d6de-445d-bb4e-35f673ac2c89 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.568286 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a30df-d6de-445d-bb4e-35f673ac2c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.568834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a30df-d6de-445d-bb4e-35f673ac2c89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.585382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a30df-d6de-445d-bb4e-35f673ac2c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-731a30df-d6de-445d-bb4e-35f673ac2c89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:09.592913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:09.593894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:09.594705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:09.596837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 159/308] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:09.602895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a30df-d6de-445d-bb4e-35f673ac2c89 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.644534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:09.645785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 150/309] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:09.717255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a30df-d6de-445d-bb4e-35f673ac2c89 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:09.753213 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c35a5-0816-498e-ab8a-5099c5d36379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.753833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c35a5-0816-498e-ab8a-5099c5d36379 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.754111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c35a5-0816-498e-ab8a-5099c5d36379 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.754379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c35a5-0816-498e-ab8a-5099c5d36379 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.755082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c35a5-0816-498e-ab8a-5099c5d36379 None admin] RBAC: Adding query filter params (name=member) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:09.755385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c35a5-0816-498e-ab8a-5099c5d36379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.757293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c35a5-0816-498e-ab8a-5099c5d36379 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.767876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 160/310] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:09.773490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1942-dcf5-49ff-ba3e-052068160f71 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.784530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:09.887088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1942-dcf5-49ff-ba3e-052068160f71 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:09.925011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ea89-e286-4139-97b4-10d1c47bc855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.925907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ea89-e286-4139-97b4-10d1c47bc855 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.926325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ea89-e286-4139-97b4-10d1c47bc855 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.926733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ea89-e286-4139-97b4-10d1c47bc855 None admin] PATH_INFO: `/v3/users/57af589b8b964c49a3828726262cff58` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.928153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6ea89-e286-4139-97b4-10d1c47bc855 None admin] RBAC: Authorizing `identity:get_user(user_id=57af589b8b964c49a3828726262cff58)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.929681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c35a5-0816-498e-ab8a-5099c5d36379 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.930255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6ea89-e286-4139-97b4-10d1c47bc855 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.932579 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 151/311] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:09 2022] GET /identity/v3/users/57af589b8b964c49a3828726262cff58 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:09.939708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ea89-e286-4139-97b4-10d1c47bc855 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.034932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:10.057840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:10.064198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c35a5-0816-498e-ab8a-5099c5d36379 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:10.072093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ea89-e286-4139-97b4-10d1c47bc855 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:10.108110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9724ac1-facc-4c0b-b13e-b6a4e8f1bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:10.109105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9724ac1-facc-4c0b-b13e-b6a4e8f1bf5e None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:10.109484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9724ac1-facc-4c0b-b13e-b6a4e8f1bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:10.109888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9724ac1-facc-4c0b-b13e-b6a4e8f1bf5e None admin] PATH_INFO: `/v3/system/users/57af589b8b964c49a3828726262cff58/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:10.109981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4546-0f40-4e52-95e2-cf43b9e8256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:10.110530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4546-0f40-4e52-95e2-cf43b9e8256a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:10.110835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4546-0f40-4e52-95e2-cf43b9e8256a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:10.111114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4546-0f40-4e52-95e2-cf43b9e8256a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:10.111858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9724ac1-facc-4c0b-b13e-b6a4e8f1bf5e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=57af589b8b964c49a3828726262cff58, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:10.113558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9724ac1-facc-4c0b-b13e-b6a4e8f1bf5e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:10.123991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f4546-0f40-4e52-95e2-cf43b9e8256a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:10.126065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 152/312] 10.222.0.65 () {58 vars in 1334 bytes} [Thu Aug 18 20:34:09 2022] PUT /identity/v3/system/users/57af589b8b964c49a3828726262cff58/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-7c3f4546-0f40-4e52-95e2-cf43b9e8256a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:10.134264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:10.135303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:10.136184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:10.138948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 161/313] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:10.150052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9724ac1-facc-4c0b-b13e-b6a4e8f1bf5e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.268146 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9724ac1-facc-4c0b-b13e-b6a4e8f1bf5e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:10.305377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d336-10aa-4790-a066-fbd75d2f3c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:10.306346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d336-10aa-4790-a066-fbd75d2f3c11 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:10.306857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d336-10aa-4790-a066-fbd75d2f3c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:10.307334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d336-10aa-4790-a066-fbd75d2f3c11 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:10.308201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510d336-10aa-4790-a066-fbd75d2f3c11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:10.308722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510d336-10aa-4790-a066-fbd75d2f3c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:10.310408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510d336-10aa-4790-a066-fbd75d2f3c11 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:10.319934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 153/314] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:10.326258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4546-0f40-4e52-95e2-cf43b9e8256a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.445919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4546-0f40-4e52-95e2-cf43b9e8256a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:10.485794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac8b91-3b04-44a6-a511-2e780d895410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:10.486459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac8b91-3b04-44a6-a511-2e780d895410 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:10.486741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac8b91-3b04-44a6-a511-2e780d895410 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:10.487041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac8b91-3b04-44a6-a511-2e780d895410 None admin] PATH_INFO: `/v3/users/3bcbd6b68bac4645b67a8ea756bc97a8` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:10.488218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac8b91-3b04-44a6-a511-2e780d895410 None admin] RBAC: Authorizing `identity:get_user(user_id=3bcbd6b68bac4645b67a8ea756bc97a8)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:10.489685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac8b91-3b04-44a6-a511-2e780d895410 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:10.492343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 162/315] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:10 2022] GET /identity/v3/users/3bcbd6b68bac4645b67a8ea756bc97a8 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:10.497883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d336-10aa-4790-a066-fbd75d2f3c11 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.501570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:10.617173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d336-10aa-4790-a066-fbd75d2f3c11 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:10.655133 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d613ec8-f1dc-43db-9571-95e14360dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:10.655774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d613ec8-f1dc-43db-9571-95e14360dc9b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:10.656058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d613ec8-f1dc-43db-9571-95e14360dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:10.656338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d613ec8-f1dc-43db-9571-95e14360dc9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:10.734031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d613ec8-f1dc-43db-9571-95e14360dc9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:10.735552 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d613ec8-f1dc-43db-9571-95e14360dc9b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:10.737482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:10.841312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 154/316] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:10.847914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac8b91-3b04-44a6-a511-2e780d895410 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.878177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:10.963694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac8b91-3b04-44a6-a511-2e780d895410 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.001595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5949f4d-8841-4b25-9143-3ce344e02619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.002236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949f4d-8841-4b25-9143-3ce344e02619 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.002515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949f4d-8841-4b25-9143-3ce344e02619 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.002806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949f4d-8841-4b25-9143-3ce344e02619 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.003939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5949f4d-8841-4b25-9143-3ce344e02619 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.005399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5949f4d-8841-4b25-9143-3ce344e02619 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.007475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 163/317] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:10 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:11.015918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d613ec8-f1dc-43db-9571-95e14360dc9b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.122355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d613ec8-f1dc-43db-9571-95e14360dc9b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.124217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.164724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f614a5-2b81-4367-a558-ed38237ca2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.165339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f614a5-2b81-4367-a558-ed38237ca2e2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.165620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f614a5-2b81-4367-a558-ed38237ca2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.165889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f614a5-2b81-4367-a558-ed38237ca2e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.166620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f614a5-2b81-4367-a558-ed38237ca2e2 None admin] RBAC: Adding query filter params (role.id=2628e24e62034387a031fadb4b6d21a7, scope.project.id=242f77755a624c91b449fbc88eeae5ef, user.id=3bcbd6b68bac4645b67a8ea756bc97a8) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:11.166962 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f614a5-2b81-4367-a558-ed38237ca2e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.168402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f614a5-2b81-4367-a558-ed38237ca2e2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.174966 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 155/318] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/role_assignments?user.id=3bcbd6b68bac4645b67a8ea756bc97a8&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=2628e24e62034387a031fadb4b6d21a7 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:11.356029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c7155-9f16-4c9d-9ece-5c1ecbe86d2d None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.356372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c7155-9f16-4c9d-9ece-5c1ecbe86d2d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.356586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c7155-9f16-4c9d-9ece-5c1ecbe86d2d None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.358205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 164/319] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:11.363436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332f78-a487-40e6-8e99-609347050728 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.363891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332f78-a487-40e6-8e99-609347050728 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.364076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332f78-a487-40e6-8e99-609347050728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.386896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-87332f78-a487-40e6-8e99-609347050728 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:11.388034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-87332f78-a487-40e6-8e99-609347050728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:11.458537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 156/320] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:11.586074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2b863-edec-4178-b1e8-d3d67388501a None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.586364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2b863-edec-4178-b1e8-d3d67388501a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.586673 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2b863-edec-4178-b1e8-d3d67388501a None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.588093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 165/321] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:11.593518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc706-a0e9-475f-b1f8-85fbfc3c4d8a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.593815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc706-a0e9-475f-b1f8-85fbfc3c4d8a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.594094 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc706-a0e9-475f-b1f8-85fbfc3c4d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.612845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3b5bc706-a0e9-475f-b1f8-85fbfc3c4d8a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:11.614079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3b5bc706-a0e9-475f-b1f8-85fbfc3c4d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:11.686817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 157/322] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:11.723375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2b863-edec-4178-b1e8-d3d67388501a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.825899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.835179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2b863-edec-4178-b1e8-d3d67388501a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.870287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473a63a-42cd-4fd8-8172-2a857cf4c59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.870952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473a63a-42cd-4fd8-8172-2a857cf4c59d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.871235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473a63a-42cd-4fd8-8172-2a857cf4c59d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.871509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473a63a-42cd-4fd8-8172-2a857cf4c59d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.872615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473a63a-42cd-4fd8-8172-2a857cf4c59d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.874104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473a63a-42cd-4fd8-8172-2a857cf4c59d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.875889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 166/323] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:11.881325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc706-a0e9-475f-b1f8-85fbfc3c4d8a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.911223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.964406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473a63a-42cd-4fd8-8172-2a857cf4c59d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.989102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc706-a0e9-475f-b1f8-85fbfc3c4d8a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.025530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d9865-752f-4dd0-859f-ff0b37d78012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.026180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d9865-752f-4dd0-859f-ff0b37d78012 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.026461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d9865-752f-4dd0-859f-ff0b37d78012 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.026737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d9865-752f-4dd0-859f-ff0b37d78012 None admin] PATH_INFO: `/v3/groups` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.027395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d9865-752f-4dd0-859f-ff0b37d78012 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.028857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d9865-752f-4dd0-859f-ff0b37d78012 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.045017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 158/324] 10.222.0.65 () {60 vars in 1134 bytes} [Thu Aug 18 20:34:11 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:12.082633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473a63a-42cd-4fd8-8172-2a857cf4c59d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.116698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd318-ade2-45fe-ac30-19121d15dc28 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.116932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd318-ade2-45fe-ac30-19121d15dc28 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.117205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd318-ade2-45fe-ac30-19121d15dc28 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.119033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 159/325] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:12.124166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5be13-2912-4afd-94e3-b706df03a1b8 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.124505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5be13-2912-4afd-94e3-b706df03a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.124715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5be13-2912-4afd-94e3-b706df03a1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.127809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff31dc6-b548-4b49-8f48-c9a5cedc32c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.128458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff31dc6-b548-4b49-8f48-c9a5cedc32c8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.128734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff31dc6-b548-4b49-8f48-c9a5cedc32c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.129005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff31dc6-b548-4b49-8f48-c9a5cedc32c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.141922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff31dc6-b548-4b49-8f48-c9a5cedc32c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:12.144260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-42e5be13-2912-4afd-94e3-b706df03a1b8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:12.145496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-42e5be13-2912-4afd-94e3-b706df03a1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4ff31dc6-b548-4b49-8f48-c9a5cedc32c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:12.148083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:12.149021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:12.149846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 167/326] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:12.154925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff31dc6-b548-4b49-8f48-c9a5cedc32c8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.183262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.236332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 160/327] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:12.275553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff31dc6-b548-4b49-8f48-c9a5cedc32c8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.313837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec9ae3-b082-468c-95c3-c3a25d6de65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.314060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec9ae3-b082-468c-95c3-c3a25d6de65a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.314233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec9ae3-b082-468c-95c3-c3a25d6de65a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.314441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec9ae3-b082-468c-95c3-c3a25d6de65a None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.315993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec9ae3-b082-468c-95c3-c3a25d6de65a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:12.315993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec9ae3-b082-468c-95c3-c3a25d6de65a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.316813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec9ae3-b082-468c-95c3-c3a25d6de65a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.326385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 168/328] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:12.331776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5be13-2912-4afd-94e3-b706df03a1b8 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.351279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.442739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5be13-2912-4afd-94e3-b706df03a1b8 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.483960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a0809-249f-42e5-b599-c7f10328007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.484607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a0809-249f-42e5-b599-c7f10328007e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.484881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a0809-249f-42e5-b599-c7f10328007e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.485145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a0809-249f-42e5-b599-c7f10328007e None admin] PATH_INFO: `/v3/users/b2fedfbf621041c2bac99651f8183f31` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.486310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a0809-249f-42e5-b599-c7f10328007e None admin] RBAC: Authorizing `identity:get_user(user_id=b2fedfbf621041c2bac99651f8183f31)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.487909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a0809-249f-42e5-b599-c7f10328007e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.489849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 161/329] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/users/b2fedfbf621041c2bac99651f8183f31 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:12.495677 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec9ae3-b082-468c-95c3-c3a25d6de65a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.526439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a0809-249f-42e5-b599-c7f10328007e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.597643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.617156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec9ae3-b082-468c-95c3-c3a25d6de65a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.653840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd63d93-e86a-4169-9e49-d2b4975eb34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.654608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd63d93-e86a-4169-9e49-d2b4975eb34d None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.654965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd63d93-e86a-4169-9e49-d2b4975eb34d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.655246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd63d93-e86a-4169-9e49-d2b4975eb34d None admin] PATH_INFO: `/v3/system/users/b2fedfbf621041c2bac99651f8183f31/roles/2628e24e62034387a031fadb4b6d21a7` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.656685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd63d93-e86a-4169-9e49-d2b4975eb34d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b2fedfbf621041c2bac99651f8183f31, role_id=2628e24e62034387a031fadb4b6d21a7)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.656795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.658303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd63d93-e86a-4169-9e49-d2b4975eb34d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.670837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 169/330] 10.222.0.65 () {58 vars in 1334 bytes} [Thu Aug 18 20:34:12 2022] PUT /identity/v3/system/users/b2fedfbf621041c2bac99651f8183f31/roles/2628e24e62034387a031fadb4b6d21a7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:34:12.684639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a0809-249f-42e5-b599-c7f10328007e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.733923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16464c6b-cabd-406f-b234-7260693577ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.734590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16464c6b-cabd-406f-b234-7260693577ee None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.734907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16464c6b-cabd-406f-b234-7260693577ee None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.735186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16464c6b-cabd-406f-b234-7260693577ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.748660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16464c6b-cabd-406f-b234-7260693577ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-16464c6b-cabd-406f-b234-7260693577ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:12.754309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:12.755290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:12.756319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 162/331] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:12.762293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd63d93-e86a-4169-9e49-d2b4975eb34d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.898630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd63d93-e86a-4169-9e49-d2b4975eb34d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.937227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77e341-3744-4799-a36f-1afabd1e66ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.937846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77e341-3744-4799-a36f-1afabd1e66ff None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.938120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77e341-3744-4799-a36f-1afabd1e66ff None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.938388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77e341-3744-4799-a36f-1afabd1e66ff None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.939185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77e341-3744-4799-a36f-1afabd1e66ff None admin] RBAC: Adding query filter params (name=member) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:12.939484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77e341-3744-4799-a36f-1afabd1e66ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.940866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77e341-3744-4799-a36f-1afabd1e66ff None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.950261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 170/332] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:12.958144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16464c6b-cabd-406f-b234-7260693577ee None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.074600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16464c6b-cabd-406f-b234-7260693577ee None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.110165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4207c-f192-4e89-ba9f-8868b2d6715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.110832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4207c-f192-4e89-ba9f-8868b2d6715c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.111111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4207c-f192-4e89-ba9f-8868b2d6715c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.111380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4207c-f192-4e89-ba9f-8868b2d6715c None admin] PATH_INFO: `/v3/users/57af589b8b964c49a3828726262cff58` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.112531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4207c-f192-4e89-ba9f-8868b2d6715c None admin] RBAC: Authorizing `identity:get_user(user_id=57af589b8b964c49a3828726262cff58)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.114116 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4207c-f192-4e89-ba9f-8868b2d6715c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.117060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 163/333] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/users/57af589b8b964c49a3828726262cff58 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:13.122947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77e341-3744-4799-a36f-1afabd1e66ff None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.138330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:13.244724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77e341-3744-4799-a36f-1afabd1e66ff None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.288807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c592d-93b8-4ae4-a756-528a1568dd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.289428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c592d-93b8-4ae4-a756-528a1568dd93 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.289706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c592d-93b8-4ae4-a756-528a1568dd93 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.289978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c592d-93b8-4ae4-a756-528a1568dd93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.290708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c592d-93b8-4ae4-a756-528a1568dd93 None admin] RBAC: Adding query filter params (role.id=b7551ed385954688a565792f95efda9c, user.id=57af589b8b964c49a3828726262cff58, scope.system=all) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:13.291044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c592d-93b8-4ae4-a756-528a1568dd93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.292506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c592d-93b8-4ae4-a756-528a1568dd93 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.308666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 171/334] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/role_assignments?user.id=57af589b8b964c49a3828726262cff58&scope.system=all&role.id=b7551ed385954688a565792f95efda9c => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:14.552012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc77db3-e384-4fa6-acad-6965d99ee7a8 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.553720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc77db3-e384-4fa6-acad-6965d99ee7a8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.554221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc77db3-e384-4fa6-acad-6965d99ee7a8 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.556068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 164/335] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:14.566960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba6ad2-43a8-49f7-acf9-f7fc37968efb None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.567432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba6ad2-43a8-49f7-acf9-f7fc37968efb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.567507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba6ad2-43a8-49f7-acf9-f7fc37968efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.597035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-84ba6ad2-43a8-49f7-acf9-f7fc37968efb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:14.598535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-84ba6ad2-43a8-49f7-acf9-f7fc37968efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:14.696262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:14.703013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 172/336] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:14.889781 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62131d19-f86c-4ba3-a33f-6c0f0e2f634e None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.889948 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62131d19-f86c-4ba3-a33f-6c0f0e2f634e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.890232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62131d19-f86c-4ba3-a33f-6c0f0e2f634e None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.891937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 165/337] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:14.898554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e7eb6-abee-4dcd-a9ac-98a0980a54d5 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.898868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e7eb6-abee-4dcd-a9ac-98a0980a54d5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.899144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e7eb6-abee-4dcd-a9ac-98a0980a54d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.921893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ad1e7eb6-abee-4dcd-a9ac-98a0980a54d5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:14.923178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ad1e7eb6-abee-4dcd-a9ac-98a0980a54d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:15.012205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 173/338] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:15.202860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62131d19-f86c-4ba3-a33f-6c0f0e2f634e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.219914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.332670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62131d19-f86c-4ba3-a33f-6c0f0e2f634e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.380054 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c54e0-90a9-4fb0-bcb8-88d36cbdd2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.380701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c54e0-90a9-4fb0-bcb8-88d36cbdd2ac None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.381528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c54e0-90a9-4fb0-bcb8-88d36cbdd2ac None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.382503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c54e0-90a9-4fb0-bcb8-88d36cbdd2ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.395773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c54e0-90a9-4fb0-bcb8-88d36cbdd2ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1f4c54e0-90a9-4fb0-bcb8-88d36cbdd2ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:15.401556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:15.402438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:15.403271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 166/339] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:15.410267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e7eb6-abee-4dcd-a9ac-98a0980a54d5 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.461701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c54e0-90a9-4fb0-bcb8-88d36cbdd2ac None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.571815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.587604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e7eb6-abee-4dcd-a9ac-98a0980a54d5 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.620284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.631274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b14d8-633c-432f-bcf3-8c3a097cda15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.632031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b14d8-633c-432f-bcf3-8c3a097cda15 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.632110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b14d8-633c-432f-bcf3-8c3a097cda15 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.632376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b14d8-633c-432f-bcf3-8c3a097cda15 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.633043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b14d8-633c-432f-bcf3-8c3a097cda15 None admin] RBAC: Adding query filter params (name=member) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:15.633582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b14d8-633c-432f-bcf3-8c3a097cda15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.634999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b14d8-633c-432f-bcf3-8c3a097cda15 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.648368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 174/340] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:15.653895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c54e0-90a9-4fb0-bcb8-88d36cbdd2ac None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.656577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b14d8-633c-432f-bcf3-8c3a097cda15 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.724681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50ef86-f048-4cad-a0ae-1dc2f103f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.726389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ef86-f048-4cad-a0ae-1dc2f103f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.726901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ef86-f048-4cad-a0ae-1dc2f103f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.727372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ef86-f048-4cad-a0ae-1dc2f103f2e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.751027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50ef86-f048-4cad-a0ae-1dc2f103f2e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-fe50ef86-f048-4cad-a0ae-1dc2f103f2e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:15.759155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:15.760120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:15.760929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:15.768328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 167/341] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:15.770160 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29890-472e-4f52-9e7b-58f759483c42 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.770639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29890-472e-4f52-9e7b-58f759483c42 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.771382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29890-472e-4f52-9e7b-58f759483c42 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.773263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 168/342] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:15.775829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29890-472e-4f52-9e7b-58f759483c42 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.852604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b14d8-633c-432f-bcf3-8c3a097cda15 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.904767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c8d2-3465-4bb4-95f1-1b8515cfdc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.905745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c8d2-3465-4bb4-95f1-1b8515cfdc95 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.907035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c8d2-3465-4bb4-95f1-1b8515cfdc95 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.907516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c8d2-3465-4bb4-95f1-1b8515cfdc95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.921938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29890-472e-4f52-9e7b-58f759483c42 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.966803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.968777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45af7e-aec3-4518-a7ff-43f6b3fdb4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.969613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45af7e-aec3-4518-a7ff-43f6b3fdb4eb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.970054 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45af7e-aec3-4518-a7ff-43f6b3fdb4eb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.970471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45af7e-aec3-4518-a7ff-43f6b3fdb4eb None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.971372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45af7e-aec3-4518-a7ff-43f6b3fdb4eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:15.971839 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45af7e-aec3-4518-a7ff-43f6b3fdb4eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.973420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45af7e-aec3-4518-a7ff-43f6b3fdb4eb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.974379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.988002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5c8d2-3465-4bb4-95f1-1b8515cfdc95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.989869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5c8d2-3465-4bb4-95f1-1b8515cfdc95 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.990845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 169/343] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:15.994790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0abfa-b49f-4969-b2f8-914f8ab1cf13 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.995086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0abfa-b49f-4969-b2f8-914f8ab1cf13 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.995371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0abfa-b49f-4969-b2f8-914f8ab1cf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.017611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-deb0abfa-b49f-4969-b2f8-914f8ab1cf13 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:16.018873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-deb0abfa-b49f-4969-b2f8-914f8ab1cf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:16.104336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 170/344] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:16.111950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0abfa-b49f-4969-b2f8-914f8ab1cf13 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.126977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 175/345] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:16.128584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878ebe-cbcd-4a0e-8012-83390c23925a None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.128871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878ebe-cbcd-4a0e-8012-83390c23925a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.129143 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878ebe-cbcd-4a0e-8012-83390c23925a None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.135682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 176/346] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:16.137226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3878ebe-cbcd-4a0e-8012-83390c23925a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.259964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0abfa-b49f-4969-b2f8-914f8ab1cf13 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:16.291221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:16.299966 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b39b72-bafa-4603-92c9-e556acd5fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.300795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b39b72-bafa-4603-92c9-e556acd5fe36 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.301389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b39b72-bafa-4603-92c9-e556acd5fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.301767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b39b72-bafa-4603-92c9-e556acd5fe36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.335354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:16.340189 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3878ebe-cbcd-4a0e-8012-83390c23925a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:16.397102 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e4dd5-9426-421d-8107-4119ffc5fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.397914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e4dd5-9426-421d-8107-4119ffc5fb15 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.398192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e4dd5-9426-421d-8107-4119ffc5fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.398464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e4dd5-9426-421d-8107-4119ffc5fb15 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.399349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b39b72-bafa-4603-92c9-e556acd5fe36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:16.399632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e4dd5-9426-421d-8107-4119ffc5fb15 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:16.401072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e4dd5-9426-421d-8107-4119ffc5fb15 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:16.401181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b39b72-bafa-4603-92c9-e556acd5fe36 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:16.403040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 177/347] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:16.404176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad0db0-a5eb-4aef-a020-e5f712b69610 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.404450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad0db0-a5eb-4aef-a020-e5f712b69610 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.404716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad0db0-a5eb-4aef-a020-e5f712b69610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.440983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c6ad0db0-a5eb-4aef-a020-e5f712b69610 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:16.442188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c6ad0db0-a5eb-4aef-a020-e5f712b69610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:16.526706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 171/348] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:16.527472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 178/349] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:16.527675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b39b72-bafa-4603-92c9-e556acd5fe36 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.528327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad0db0-a5eb-4aef-a020-e5f712b69610 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.571200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:16.644272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad0db0-a5eb-4aef-a020-e5f712b69610 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:16.659191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:16.670367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b39b72-bafa-4603-92c9-e556acd5fe36 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:16.687688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168bd06-13e9-4f43-acae-1c0df2092376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.690241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168bd06-13e9-4f43-acae-1c0df2092376 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.690241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168bd06-13e9-4f43-acae-1c0df2092376 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.690241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168bd06-13e9-4f43-acae-1c0df2092376 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.702167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168bd06-13e9-4f43-acae-1c0df2092376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-1168bd06-13e9-4f43-acae-1c0df2092376 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:16.710448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:16.711814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 179/350] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:16.712937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168bd06-13e9-4f43-acae-1c0df2092376 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.737953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9279377-4a52-421c-ad46-709da7c2a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.738605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9279377-4a52-421c-ad46-709da7c2a81d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.738998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9279377-4a52-421c-ad46-709da7c2a81d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.739273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9279377-4a52-421c-ad46-709da7c2a81d None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.747199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9279377-4a52-421c-ad46-709da7c2a81d None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:16.748858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9279377-4a52-421c-ad46-709da7c2a81d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:16.751234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 172/351] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:16.751840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9279377-4a52-421c-ad46-709da7c2a81d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.867302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:16.871960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9279377-4a52-421c-ad46-709da7c2a81d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:16.908171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168bd06-13e9-4f43-acae-1c0df2092376 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:16.917145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5789e5-e9ad-4991-9cf5-569aded9fae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.917764 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5789e5-e9ad-4991-9cf5-569aded9fae7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.918056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5789e5-e9ad-4991-9cf5-569aded9fae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.918415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5789e5-e9ad-4991-9cf5-569aded9fae7 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.919208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5789e5-e9ad-4991-9cf5-569aded9fae7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:16.919514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5789e5-e9ad-4991-9cf5-569aded9fae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:16.921007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5789e5-e9ad-4991-9cf5-569aded9fae7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:16.931102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 173/352] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:16.931783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5789e5-e9ad-4991-9cf5-569aded9fae7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.951916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5c92b-f378-4585-902a-7a1bd98dc6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.951916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5c92b-f378-4585-902a-7a1bd98dc6d8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.951916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5c92b-f378-4585-902a-7a1bd98dc6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.951916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5c92b-f378-4585-902a-7a1bd98dc6d8 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.952478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5c92b-f378-4585-902a-7a1bd98dc6d8 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:16.953922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5c92b-f378-4585-902a-7a1bd98dc6d8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:16.955811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 180/353] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:16.956801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab160-22dd-429d-8738-dfffc55727c8 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.957081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab160-22dd-429d-8738-dfffc55727c8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.957352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab160-22dd-429d-8738-dfffc55727c8 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.959438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 181/354] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:16.960519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717d328-9862-42f5-99c6-3e099bb1f494 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.960800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717d328-9862-42f5-99c6-3e099bb1f494 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.961076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717d328-9862-42f5-99c6-3e099bb1f494 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.962309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 182/355] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:16.963274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717d328-9862-42f5-99c6-3e099bb1f494 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.985556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.068081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5789e5-e9ad-4991-9cf5-569aded9fae7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.100548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717d328-9862-42f5-99c6-3e099bb1f494 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.113662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea145c-87f8-4621-b62b-55cdb5c125ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.114275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea145c-87f8-4621-b62b-55cdb5c125ce None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.114561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea145c-87f8-4621-b62b-55cdb5c125ce None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.114892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea145c-87f8-4621-b62b-55cdb5c125ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.116054 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea145c-87f8-4621-b62b-55cdb5c125ce None admin] RBAC: Adding query filter params (group.id=25143406e241439aaeee829da5d69456, role.id=b7551ed385954688a565792f95efda9c, scope.project.id=65e5d2374d6d489d9ce0f7c913737262) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:17.116367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea145c-87f8-4621-b62b-55cdb5c125ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.117961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea145c-87f8-4621-b62b-55cdb5c125ce None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.128409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 174/356] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/role_assignments?group.id=25143406e241439aaeee829da5d69456&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=b7551ed385954688a565792f95efda9c => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:17.128409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea145c-87f8-4621-b62b-55cdb5c125ce None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.141016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be608cb4-6f86-434f-a72e-2399e8069a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.141232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be608cb4-6f86-434f-a72e-2399e8069a53 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.141562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be608cb4-6f86-434f-a72e-2399e8069a53 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.141837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be608cb4-6f86-434f-a72e-2399e8069a53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.152170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.170619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be608cb4-6f86-434f-a72e-2399e8069a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-be608cb4-6f86-434f-a72e-2399e8069a53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:17.175612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:17.176550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 183/357] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:17.177369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be608cb4-6f86-434f-a72e-2399e8069a53 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.279926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.300211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea145c-87f8-4621-b62b-55cdb5c125ce None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.318979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be608cb4-6f86-434f-a72e-2399e8069a53 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.347196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bb25e-3357-4613-a28a-11cf65b95faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.348010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb25e-3357-4613-a28a-11cf65b95faa None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.348294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb25e-3357-4613-a28a-11cf65b95faa None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.348572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb25e-3357-4613-a28a-11cf65b95faa None admin] PATH_INFO: `/v3/users/b2fedfbf621041c2bac99651f8183f31` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.350394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bb25e-3357-4613-a28a-11cf65b95faa None admin] RBAC: Authorizing `identity:get_user(user_id=b2fedfbf621041c2bac99651f8183f31)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.352272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bb25e-3357-4613-a28a-11cf65b95faa None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.354435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 175/358] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/users/b2fedfbf621041c2bac99651f8183f31 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:17.355635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e8a7-166c-4526-b1ad-dd2c28e55624 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.355920 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e8a7-166c-4526-b1ad-dd2c28e55624 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.356196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e8a7-166c-4526-b1ad-dd2c28e55624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.362301 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf26c95-562d-4f96-9156-c8aa45f60b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.363082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf26c95-562d-4f96-9156-c8aa45f60b7d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.363267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf26c95-562d-4f96-9156-c8aa45f60b7d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.363586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf26c95-562d-4f96-9156-c8aa45f60b7d None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.364777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf26c95-562d-4f96-9156-c8aa45f60b7d None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.366719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf26c95-562d-4f96-9156-c8aa45f60b7d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.368580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 184/359] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:17.370601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2a27-b74e-4caa-ad57-1af011012007 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.372066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2a27-b74e-4caa-ad57-1af011012007 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.372561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2a27-b74e-4caa-ad57-1af011012007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.381938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0ea1e8a7-166c-4526-b1ad-dd2c28e55624 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:17.383643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0ea1e8a7-166c-4526-b1ad-dd2c28e55624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:17.397724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-442f2a27-b74e-4caa-ad57-1af011012007 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:17.399372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-442f2a27-b74e-4caa-ad57-1af011012007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:17.480372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 176/360] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:17.481581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1e8a7-166c-4526-b1ad-dd2c28e55624 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.503161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 185/361] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:17.504255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2a27-b74e-4caa-ad57-1af011012007 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.513470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.635956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2a27-b74e-4caa-ad57-1af011012007 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.639106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.675402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c8b6c-6f2d-4579-b9db-210a00c638fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.676167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c8b6c-6f2d-4579-b9db-210a00c638fb None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.676453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c8b6c-6f2d-4579-b9db-210a00c638fb None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.676723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c8b6c-6f2d-4579-b9db-210a00c638fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.677461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c8b6c-6f2d-4579-b9db-210a00c638fb None admin] RBAC: Adding query filter params (role.id=2628e24e62034387a031fadb4b6d21a7, user.id=b2fedfbf621041c2bac99651f8183f31, scope.system=all) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:17.677944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c8b6c-6f2d-4579-b9db-210a00c638fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.679639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c8b6c-6f2d-4579-b9db-210a00c638fb None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.692863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 186/362] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/role_assignments?user.id=b2fedfbf621041c2bac99651f8183f31&scope.system=all&role.id=2628e24e62034387a031fadb4b6d21a7 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:17.693836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c8b6c-6f2d-4579-b9db-210a00c638fb None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.786665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1e8a7-166c-4526-b1ad-dd2c28e55624 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.852687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c8b6c-6f2d-4579-b9db-210a00c638fb None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.885676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803c973-6c04-4511-a9a4-b3968b116e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.887821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803c973-6c04-4511-a9a4-b3968b116e5e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.888415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803c973-6c04-4511-a9a4-b3968b116e5e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.889150 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803c973-6c04-4511-a9a4-b3968b116e5e None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.891143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803c973-6c04-4511-a9a4-b3968b116e5e None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:17.891688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803c973-6c04-4511-a9a4-b3968b116e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.893387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803c973-6c04-4511-a9a4-b3968b116e5e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.903555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 177/363] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:17.903795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.904832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803c973-6c04-4511-a9a4-b3968b116e5e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.917002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa03d-f2ed-4782-8184-69ccfb900cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.917531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa03d-f2ed-4782-8184-69ccfb900cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.917916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa03d-f2ed-4782-8184-69ccfb900cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.918261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa03d-f2ed-4782-8184-69ccfb900cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.919134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fa03d-f2ed-4782-8184-69ccfb900cb7 None admin] RBAC: Adding query filter params (group.id=25143406e241439aaeee829da5d69456, role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=65e5d2374d6d489d9ce0f7c913737262) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:17.919518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fa03d-f2ed-4782-8184-69ccfb900cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.921385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fa03d-f2ed-4782-8184-69ccfb900cb7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.928158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 187/364] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/role_assignments?group.id=25143406e241439aaeee829da5d69456&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:17.929573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa03d-f2ed-4782-8184-69ccfb900cb7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.996129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.026824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803c973-6c04-4511-a9a4-b3968b116e5e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.066182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2250e63-22cf-4eef-812f-203650956e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.067105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2250e63-22cf-4eef-812f-203650956e05 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.067465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2250e63-22cf-4eef-812f-203650956e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.067780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2250e63-22cf-4eef-812f-203650956e05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.074350 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa03d-f2ed-4782-8184-69ccfb900cb7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.081138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2250e63-22cf-4eef-812f-203650956e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e2250e63-22cf-4eef-812f-203650956e05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:18.088940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:18.089951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:18.090816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 178/365] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:18.091508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2250e63-22cf-4eef-812f-203650956e05 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.134678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b495afa-c1f0-45c5-ad5f-faa229d86e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.135790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b495afa-c1f0-45c5-ad5f-faa229d86e9b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.136283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b495afa-c1f0-45c5-ad5f-faa229d86e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.136761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b495afa-c1f0-45c5-ad5f-faa229d86e9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.152727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b495afa-c1f0-45c5-ad5f-faa229d86e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-7b495afa-c1f0-45c5-ad5f-faa229d86e9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:18.158629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:18.160280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:18.161129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:18.164478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 188/366] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:18.165549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b495afa-c1f0-45c5-ad5f-faa229d86e9b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.228069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2250e63-22cf-4eef-812f-203650956e05 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.244698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.290806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998cc19-69cb-4835-9c7a-ad8f164a7d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.291471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998cc19-69cb-4835-9c7a-ad8f164a7d59 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.291754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998cc19-69cb-4835-9c7a-ad8f164a7d59 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.292031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998cc19-69cb-4835-9c7a-ad8f164a7d59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.298078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.305958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b495afa-c1f0-45c5-ad5f-faa229d86e9b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.362561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bcd62-804c-4f4c-91a9-d6cc0f3b9188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.363460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bcd62-804c-4f4c-91a9-d6cc0f3b9188 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.363894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bcd62-804c-4f4c-91a9-d6cc0f3b9188 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.364534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bcd62-804c-4f4c-91a9-d6cc0f3b9188 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.366016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bcd62-804c-4f4c-91a9-d6cc0f3b9188 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:18.366792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bcd62-804c-4f4c-91a9-d6cc0f3b9188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.368917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bcd62-804c-4f4c-91a9-d6cc0f3b9188 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.381578 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 189/367] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:18.382462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bcd62-804c-4f4c-91a9-d6cc0f3b9188 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.390379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998cc19-69cb-4835-9c7a-ad8f164a7d59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.391913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998cc19-69cb-4835-9c7a-ad8f164a7d59 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.523969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 179/368] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:18.525439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998cc19-69cb-4835-9c7a-ad8f164a7d59 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.534732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bcd62-804c-4f4c-91a9-d6cc0f3b9188 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.555134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.577732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ac7a3-57d7-4892-93b5-a92ec8f2203d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.578221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.578439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ac7a3-57d7-4892-93b5-a92ec8f2203d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.578722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ac7a3-57d7-4892-93b5-a92ec8f2203d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.579036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ac7a3-57d7-4892-93b5-a92ec8f2203d None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.579729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ac7a3-57d7-4892-93b5-a92ec8f2203d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:18.580085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ac7a3-57d7-4892-93b5-a92ec8f2203d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.582440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ac7a3-57d7-4892-93b5-a92ec8f2203d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.604482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 190/369] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:18.605252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ac7a3-57d7-4892-93b5-a92ec8f2203d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.686467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998cc19-69cb-4835-9c7a-ad8f164a7d59 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.729545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe8cc4-4d3f-4dbc-ac54-443f077f15f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.730832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe8cc4-4d3f-4dbc-ac54-443f077f15f0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.731371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe8cc4-4d3f-4dbc-ac54-443f077f15f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.731845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe8cc4-4d3f-4dbc-ac54-443f077f15f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.731958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ac7a3-57d7-4892-93b5-a92ec8f2203d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.774603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acffee8-dadf-4247-8bd1-8837362695eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.775223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acffee8-dadf-4247-8bd1-8837362695eb None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.775499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acffee8-dadf-4247-8bd1-8837362695eb None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.775764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acffee8-dadf-4247-8bd1-8837362695eb None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.776893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acffee8-dadf-4247-8bd1-8837362695eb None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.778348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acffee8-dadf-4247-8bd1-8837362695eb None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.780031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 191/370] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:18.780885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acffee8-dadf-4247-8bd1-8837362695eb None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.841191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe8cc4-4d3f-4dbc-ac54-443f077f15f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.844158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe8cc4-4d3f-4dbc-ac54-443f077f15f0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.844833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.892564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.921489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acffee8-dadf-4247-8bd1-8837362695eb None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.964159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5946f-27e5-41e4-9f66-c79c40c764d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.964835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5946f-27e5-41e4-9f66-c79c40c764d6 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.965118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5946f-27e5-41e4-9f66-c79c40c764d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.965381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5946f-27e5-41e4-9f66-c79c40c764d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.991955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 180/371] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:18.993185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe8cc4-4d3f-4dbc-ac54-443f077f15f0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.053865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5946f-27e5-41e4-9f66-c79c40c764d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.055297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5946f-27e5-41e4-9f66-c79c40c764d6 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.113777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.129159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe8cc4-4d3f-4dbc-ac54-443f077f15f0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.173860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986574b1-c5be-4aa5-b94f-ce817ae1e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.174507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986574b1-c5be-4aa5-b94f-ce817ae1e89b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.174802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986574b1-c5be-4aa5-b94f-ce817ae1e89b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.175080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986574b1-c5be-4aa5-b94f-ce817ae1e89b None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.176200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986574b1-c5be-4aa5-b94f-ce817ae1e89b None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.177735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986574b1-c5be-4aa5-b94f-ce817ae1e89b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.184440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 181/372] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.185298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 192/373] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:19.185417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986574b1-c5be-4aa5-b94f-ce817ae1e89b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.188106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5946f-27e5-41e4-9f66-c79c40c764d6 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.188422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.310264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986574b1-c5be-4aa5-b94f-ce817ae1e89b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.321204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5946f-27e5-41e4-9f66-c79c40c764d6 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.350206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fc391-0100-4c3e-9411-a36d64075a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.351301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc391-0100-4c3e-9411-a36d64075a08 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.351651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc391-0100-4c3e-9411-a36d64075a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.351992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc391-0100-4c3e-9411-a36d64075a08 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.353238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fc391-0100-4c3e-9411-a36d64075a08 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.354729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fc391-0100-4c3e-9411-a36d64075a08 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.356902 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 182/374] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.357800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fc391-0100-4c3e-9411-a36d64075a08 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.367990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0980b-eb33-46dd-93b7-5e78576560af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.369208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0980b-eb33-46dd-93b7-5e78576560af None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.369496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0980b-eb33-46dd-93b7-5e78576560af None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.369767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0980b-eb33-46dd-93b7-5e78576560af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.370509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0980b-eb33-46dd-93b7-5e78576560af None admin] RBAC: Adding query filter params (group.id=25143406e241439aaeee829da5d69456, role.id=b7551ed385954688a565792f95efda9c, scope.project.id=242f77755a624c91b449fbc88eeae5ef) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:19.370845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0980b-eb33-46dd-93b7-5e78576560af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.372699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0980b-eb33-46dd-93b7-5e78576560af None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.380960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 193/375] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/role_assignments?group.id=25143406e241439aaeee829da5d69456&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=b7551ed385954688a565792f95efda9c => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.381945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0980b-eb33-46dd-93b7-5e78576560af None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.401651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.460446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.498104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fc391-0100-4c3e-9411-a36d64075a08 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.505363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0980b-eb33-46dd-93b7-5e78576560af None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.538546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1add799-dcfe-4a7e-881b-d032e72e2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.539294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1add799-dcfe-4a7e-881b-d032e72e2a09 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.539587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1add799-dcfe-4a7e-881b-d032e72e2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.539865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1add799-dcfe-4a7e-881b-d032e72e2a09 None admin] PATH_INFO: `/v3/projects/0469791b573f4534aad86764e4849307` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.541386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1add799-dcfe-4a7e-881b-d032e72e2a09 None admin] RBAC: Authorizing `identity:get_project(project_id=0469791b573f4534aad86764e4849307)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.542928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1add799-dcfe-4a7e-881b-d032e72e2a09 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.545043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 183/376] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/projects/0469791b573f4534aad86764e4849307 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.546114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f14f7-ff9a-47e0-b515-f66cf690345a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.546406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f14f7-ff9a-47e0-b515-f66cf690345a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.546682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f14f7-ff9a-47e0-b515-f66cf690345a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.548508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 184/377] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:19.552360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f14f7-ff9a-47e0-b515-f66cf690345a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.554384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968301c-7f03-492f-abcc-fd66601fc57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.555092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968301c-7f03-492f-abcc-fd66601fc57d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.555371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968301c-7f03-492f-abcc-fd66601fc57d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.555645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968301c-7f03-492f-abcc-fd66601fc57d None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.557454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968301c-7f03-492f-abcc-fd66601fc57d None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.559023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968301c-7f03-492f-abcc-fd66601fc57d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.560960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 194/378] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.562066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd74d63-620e-4a90-825e-e2e7d57529f4 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.562342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd74d63-620e-4a90-825e-e2e7d57529f4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.562612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd74d63-620e-4a90-825e-e2e7d57529f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.590634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5fd74d63-620e-4a90-825e-e2e7d57529f4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:19.591883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5fd74d63-620e-4a90-825e-e2e7d57529f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:19.676683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 195/379] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:19.678737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd74d63-620e-4a90-825e-e2e7d57529f4 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.687519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f14f7-ff9a-47e0-b515-f66cf690345a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.693689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.732974 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d6bfe-81ee-42cd-85fe-332cd507574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.733633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d6bfe-81ee-42cd-85fe-332cd507574b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.733924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d6bfe-81ee-42cd-85fe-332cd507574b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.734473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d6bfe-81ee-42cd-85fe-332cd507574b None admin] PATH_INFO: `/v3/groups/235d1e38862945178f2302909f55ffd3` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.741749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d6bfe-81ee-42cd-85fe-332cd507574b None admin] RBAC: Authorizing `identity:get_group(group_id=235d1e38862945178f2302909f55ffd3)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.743273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d6bfe-81ee-42cd-85fe-332cd507574b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.746184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 185/380] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/groups/235d1e38862945178f2302909f55ffd3 => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:19.753074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d6bfe-81ee-42cd-85fe-332cd507574b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.758712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.815312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd74d63-620e-4a90-825e-e2e7d57529f4 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.875441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b84cf-c24c-4192-a9b5-17695697be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.876071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b84cf-c24c-4192-a9b5-17695697be85 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.876901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b84cf-c24c-4192-a9b5-17695697be85 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.877116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b84cf-c24c-4192-a9b5-17695697be85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.877814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b84cf-c24c-4192-a9b5-17695697be85 None admin] RBAC: Adding query filter params (group.id=25143406e241439aaeee829da5d69456, role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=242f77755a624c91b449fbc88eeae5ef) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:19.878124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b84cf-c24c-4192-a9b5-17695697be85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.879925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b84cf-c24c-4192-a9b5-17695697be85 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.891816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 196/381] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/role_assignments?group.id=25143406e241439aaeee829da5d69456&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.909976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d6bfe-81ee-42cd-85fe-332cd507574b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.955917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f2398-ec3a-4fa2-a388-1637853f48d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.956980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f2398-ec3a-4fa2-a388-1637853f48d2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.957518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f2398-ec3a-4fa2-a388-1637853f48d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.957985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f2398-ec3a-4fa2-a388-1637853f48d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.959750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f2398-ec3a-4fa2-a388-1637853f48d2 None admin] RBAC: Adding query filter params (group.id=235d1e38862945178f2302909f55ffd3, role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=0469791b573f4534aad86764e4849307) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:19.960338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f2398-ec3a-4fa2-a388-1637853f48d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.962039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f2398-ec3a-4fa2-a388-1637853f48d2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.969741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 186/382] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/role_assignments?group.id=235d1e38862945178f2302909f55ffd3&scope.project.id=0469791b573f4534aad86764e4849307&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:20.123069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b84cf-c24c-4192-a9b5-17695697be85 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.220994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.253446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b84cf-c24c-4192-a9b5-17695697be85 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.294920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc436e-a4da-422a-b7e9-37312767ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.295943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc436e-a4da-422a-b7e9-37312767ab46 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.296508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc436e-a4da-422a-b7e9-37312767ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.297009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc436e-a4da-422a-b7e9-37312767ab46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.311615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc436e-a4da-422a-b7e9-37312767ab46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-45cc436e-a4da-422a-b7e9-37312767ab46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:20.317300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:20.318726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:20.320008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:20.322649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 197/383] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:20.329901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f2398-ec3a-4fa2-a388-1637853f48d2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.410647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78aac5-1dfd-4cc9-840b-c8a564faa54f None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.410933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78aac5-1dfd-4cc9-840b-c8a564faa54f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.411737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78aac5-1dfd-4cc9-840b-c8a564faa54f None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.416748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 198/384] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:20.423758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003bb87-b656-4aeb-a59b-da82bc9f93e3 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.424120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003bb87-b656-4aeb-a59b-da82bc9f93e3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.424468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003bb87-b656-4aeb-a59b-da82bc9f93e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.431117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.457475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1003bb87-b656-4aeb-a59b-da82bc9f93e3 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:20.459197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1003bb87-b656-4aeb-a59b-da82bc9f93e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:20.510820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f2398-ec3a-4fa2-a388-1637853f48d2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.569413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984dc73-a06e-4c27-809c-470424a039ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.570485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984dc73-a06e-4c27-809c-470424a039ca None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.570790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984dc73-a06e-4c27-809c-470424a039ca None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.571074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984dc73-a06e-4c27-809c-470424a039ca None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.571754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984dc73-a06e-4c27-809c-470424a039ca None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:20.572057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984dc73-a06e-4c27-809c-470424a039ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.573450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984dc73-a06e-4c27-809c-470424a039ca None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.584525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 187/385] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:20.600021 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984dc73-a06e-4c27-809c-470424a039ca None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.601777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 199/386] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:20.741983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984dc73-a06e-4c27-809c-470424a039ca None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.775988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.784047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a135c-ec9c-4c20-93d8-24698e8c719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.784753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a135c-ec9c-4c20-93d8-24698e8c719a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.785033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a135c-ec9c-4c20-93d8-24698e8c719a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.785308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a135c-ec9c-4c20-93d8-24698e8c719a None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.786456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a135c-ec9c-4c20-93d8-24698e8c719a None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.788194 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a135c-ec9c-4c20-93d8-24698e8c719a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.790839 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 188/387] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:20.795307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003bb87-b656-4aeb-a59b-da82bc9f93e3 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.863512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.911283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003bb87-b656-4aeb-a59b-da82bc9f93e3 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.965415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa6976-ff92-4dff-ae84-78420a33a42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.966072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa6976-ff92-4dff-ae84-78420a33a42e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.966352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa6976-ff92-4dff-ae84-78420a33a42e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.966623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa6976-ff92-4dff-ae84-78420a33a42e None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.967831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa6976-ff92-4dff-ae84-78420a33a42e None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.969311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa6976-ff92-4dff-ae84-78420a33a42e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.975313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 200/388] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:20.980990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a135c-ec9c-4c20-93d8-24698e8c719a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.111703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a135c-ec9c-4c20-93d8-24698e8c719a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.155891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946d7b-c38b-4532-bb1e-daec3946ab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.156618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946d7b-c38b-4532-bb1e-daec3946ab81 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.156904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946d7b-c38b-4532-bb1e-daec3946ab81 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.157179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946d7b-c38b-4532-bb1e-daec3946ab81 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262/groups/25143406e241439aaeee829da5d69456/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.159089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946d7b-c38b-4532-bb1e-daec3946ab81 None admin] RBAC: Authorizing `identity:create_grant(project_id=65e5d2374d6d489d9ce0f7c913737262, group_id=25143406e241439aaeee829da5d69456, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.160532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946d7b-c38b-4532-bb1e-daec3946ab81 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.178431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 189/389] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Aug 18 20:34:20 2022] PUT /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262/groups/25143406e241439aaeee829da5d69456/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:21.260672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa6976-ff92-4dff-ae84-78420a33a42e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.395578 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa6976-ff92-4dff-ae84-78420a33a42e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.436772 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:21.444978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeb670-a6e1-4a34-be22-15bcd7b0a978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.445618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeb670-a6e1-4a34-be22-15bcd7b0a978 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.445890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeb670-a6e1-4a34-be22-15bcd7b0a978 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.446153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeb670-a6e1-4a34-be22-15bcd7b0a978 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.462297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeb670-a6e1-4a34-be22-15bcd7b0a978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-19aeb670-a6e1-4a34-be22-15bcd7b0a978 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:21.467544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:21.468524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:21.469362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:21.472227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 201/390] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:21.479956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946d7b-c38b-4532-bb1e-daec3946ab81 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.571156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:21.641753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946d7b-c38b-4532-bb1e-daec3946ab81 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.686188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e4998-8b78-45ef-afd1-a7f3a103bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.686837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e4998-8b78-45ef-afd1-a7f3a103bb28 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.687123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e4998-8b78-45ef-afd1-a7f3a103bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.687394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e4998-8b78-45ef-afd1-a7f3a103bb28 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.688067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e4998-8b78-45ef-afd1-a7f3a103bb28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:21.688374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e4998-8b78-45ef-afd1-a7f3a103bb28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.689763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e4998-8b78-45ef-afd1-a7f3a103bb28 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.703627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 190/391] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:21.705029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeb670-a6e1-4a34-be22-15bcd7b0a978 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.878304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeb670-a6e1-4a34-be22-15bcd7b0a978 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.932362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894abcd-163a-41dd-b2f6-c3ae058afec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.933004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894abcd-163a-41dd-b2f6-c3ae058afec4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.933279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894abcd-163a-41dd-b2f6-c3ae058afec4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.933549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894abcd-163a-41dd-b2f6-c3ae058afec4 None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.934661 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894abcd-163a-41dd-b2f6-c3ae058afec4 None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.936134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894abcd-163a-41dd-b2f6-c3ae058afec4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.938049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 202/392] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:21.943876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e4998-8b78-45ef-afd1-a7f3a103bb28 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.075009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e4998-8b78-45ef-afd1-a7f3a103bb28 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.099057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.123664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88112c1-fb5c-4352-aed6-425deb2e0d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.124304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88112c1-fb5c-4352-aed6-425deb2e0d1a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.124576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88112c1-fb5c-4352-aed6-425deb2e0d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.124844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88112c1-fb5c-4352-aed6-425deb2e0d1a None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.125968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88112c1-fb5c-4352-aed6-425deb2e0d1a None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.127448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88112c1-fb5c-4352-aed6-425deb2e0d1a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.129391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 191/393] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:22.135469 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894abcd-163a-41dd-b2f6-c3ae058afec4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.228162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.239961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9fb9d-b88f-483c-88fe-7eaa095e80b7 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.241070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9fb9d-b88f-483c-88fe-7eaa095e80b7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.241633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9fb9d-b88f-483c-88fe-7eaa095e80b7 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.243236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 192/394] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:22.244528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747183d-0764-458b-bb01-9d9a02785140 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.245043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747183d-0764-458b-bb01-9d9a02785140 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.245519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747183d-0764-458b-bb01-9d9a02785140 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.247212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 193/395] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:22.252652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a046fe-e2f3-4fbd-9476-0fa112cd0dcf None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.252940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a046fe-e2f3-4fbd-9476-0fa112cd0dcf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.253213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a046fe-e2f3-4fbd-9476-0fa112cd0dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.276125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-77a046fe-e2f3-4fbd-9476-0fa112cd0dcf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:22.277608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-77a046fe-e2f3-4fbd-9476-0fa112cd0dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:22.285496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894abcd-163a-41dd-b2f6-c3ae058afec4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.320511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336dd5c-a093-4b0f-a9a3-09eb915c1183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.321232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336dd5c-a093-4b0f-a9a3-09eb915c1183 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.321512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336dd5c-a093-4b0f-a9a3-09eb915c1183 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.321785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336dd5c-a093-4b0f-a9a3-09eb915c1183 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262/groups/25143406e241439aaeee829da5d69456/roles/597a1ee9b8e047e4b63712515f4994f0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.323949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336dd5c-a093-4b0f-a9a3-09eb915c1183 None admin] RBAC: Authorizing `identity:create_grant(project_id=65e5d2374d6d489d9ce0f7c913737262, group_id=25143406e241439aaeee829da5d69456, role_id=597a1ee9b8e047e4b63712515f4994f0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.325385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336dd5c-a093-4b0f-a9a3-09eb915c1183 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.340218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 203/396] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Aug 18 20:34:22 2022] PUT /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262/groups/25143406e241439aaeee829da5d69456/roles/597a1ee9b8e047e4b63712515f4994f0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:22.341589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c8e80-956f-4507-8c85-7dbb5bad8fd0 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.341893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c8e80-956f-4507-8c85-7dbb5bad8fd0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.342229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c8e80-956f-4507-8c85-7dbb5bad8fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.360359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 194/397] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:22.361856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-911c8e80-956f-4507-8c85-7dbb5bad8fd0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:22.363076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-911c8e80-956f-4507-8c85-7dbb5bad8fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:22.452004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 204/398] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:22.630810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f2f0d-776f-4620-a24a-2d759e549bfb None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.631318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f2f0d-776f-4620-a24a-2d759e549bfb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.631711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f2f0d-776f-4620-a24a-2d759e549bfb None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.633574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 195/399] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:22.639203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bb437-1945-45d5-abbf-855ab0a32eac None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.639506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bb437-1945-45d5-abbf-855ab0a32eac None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.639758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bb437-1945-45d5-abbf-855ab0a32eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.665672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-931bb437-1945-45d5-abbf-855ab0a32eac None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:22.666899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-931bb437-1945-45d5-abbf-855ab0a32eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:22.695702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f2f0d-776f-4620-a24a-2d759e549bfb None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.761531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.789151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 205/400] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:22.790088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bb437-1945-45d5-abbf-855ab0a32eac None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.897705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f2f0d-776f-4620-a24a-2d759e549bfb None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.914241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bb437-1945-45d5-abbf-855ab0a32eac None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.931017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.955134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b985bf6-5c36-49e8-a80c-75b2bbd33980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.955785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b985bf6-5c36-49e8-a80c-75b2bbd33980 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.956063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b985bf6-5c36-49e8-a80c-75b2bbd33980 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.956338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b985bf6-5c36-49e8-a80c-75b2bbd33980 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.968662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b985bf6-5c36-49e8-a80c-75b2bbd33980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-1b985bf6-5c36-49e8-a80c-75b2bbd33980 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:22.974070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:22.975118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:22.975917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 206/401] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:22.982886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b985bf6-5c36-49e8-a80c-75b2bbd33980 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.996146 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1e9be-c788-40f3-8047-2a750101c020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.996810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1e9be-c788-40f3-8047-2a750101c020 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.997090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1e9be-c788-40f3-8047-2a750101c020 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.997368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1e9be-c788-40f3-8047-2a750101c020 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.035738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.044559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1e9be-c788-40f3-8047-2a750101c020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-48e1e9be-c788-40f3-8047-2a750101c020 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:23.053280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:23.054505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:23.055330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:23.062950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 196/402] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:23.079468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1e9be-c788-40f3-8047-2a750101c020 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.119101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b985bf6-5c36-49e8-a80c-75b2bbd33980 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.161040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460dbc-afff-4b42-8176-c4a896150c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.161636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460dbc-afff-4b42-8176-c4a896150c09 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.162599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460dbc-afff-4b42-8176-c4a896150c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.162933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460dbc-afff-4b42-8176-c4a896150c09 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.163615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460dbc-afff-4b42-8176-c4a896150c09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.163924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460dbc-afff-4b42-8176-c4a896150c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.166419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460dbc-afff-4b42-8176-c4a896150c09 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.184818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 207/403] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:23.184818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460dbc-afff-4b42-8176-c4a896150c09 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.253160 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1e9be-c788-40f3-8047-2a750101c020 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.308091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460dbc-afff-4b42-8176-c4a896150c09 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.310128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.315323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed218-3806-4def-8727-89d71122dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.315956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed218-3806-4def-8727-89d71122dcbb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.316233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed218-3806-4def-8727-89d71122dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.316506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed218-3806-4def-8727-89d71122dcbb None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.317195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed218-3806-4def-8727-89d71122dcbb None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.317477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed218-3806-4def-8727-89d71122dcbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.320320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed218-3806-4def-8727-89d71122dcbb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.335261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 197/404] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.336365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed218-3806-4def-8727-89d71122dcbb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.350545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13abcd-e588-4bc7-aa1a-e3d21c56e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.351759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13abcd-e588-4bc7-aa1a-e3d21c56e754 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.352236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13abcd-e588-4bc7-aa1a-e3d21c56e754 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.352713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13abcd-e588-4bc7-aa1a-e3d21c56e754 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.364922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13abcd-e588-4bc7-aa1a-e3d21c56e754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-2a13abcd-e588-4bc7-aa1a-e3d21c56e754 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:23.370984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:23.372035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:23.372837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:23.375591 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 208/405] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:23.381970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13abcd-e588-4bc7-aa1a-e3d21c56e754 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.387383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.480514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed218-3806-4def-8727-89d71122dcbb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.525200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679d567-5118-44d3-a0cc-68550f78940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.525877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d567-5118-44d3-a0cc-68550f78940f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.526159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d567-5118-44d3-a0cc-68550f78940f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.526431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d567-5118-44d3-a0cc-68550f78940f None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.527613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679d567-5118-44d3-a0cc-68550f78940f None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.529156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679d567-5118-44d3-a0cc-68550f78940f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.531101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 198/406] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.531958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679d567-5118-44d3-a0cc-68550f78940f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.539278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13abcd-e588-4bc7-aa1a-e3d21c56e754 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.592638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7cf32-9071-4641-9271-5551659bea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.593314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7cf32-9071-4641-9271-5551659bea00 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.593596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7cf32-9071-4641-9271-5551659bea00 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.593867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7cf32-9071-4641-9271-5551659bea00 None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.595056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7cf32-9071-4641-9271-5551659bea00 None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.596508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7cf32-9071-4641-9271-5551659bea00 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.605617 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 209/407] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.606589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7cf32-9071-4641-9271-5551659bea00 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.662684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.687038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679d567-5118-44d3-a0cc-68550f78940f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.699695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.744400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6f6b-9606-4d33-b328-3e63f9546a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.745564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6f6b-9606-4d33-b328-3e63f9546a33 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.745997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6f6b-9606-4d33-b328-3e63f9546a33 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.746694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6f6b-9606-4d33-b328-3e63f9546a33 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.747881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6f6b-9606-4d33-b328-3e63f9546a33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.748360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6f6b-9606-4d33-b328-3e63f9546a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.750211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6f6b-9606-4d33-b328-3e63f9546a33 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.761782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7cf32-9071-4641-9271-5551659bea00 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.762895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 199/408] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.763998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6f6b-9606-4d33-b328-3e63f9546a33 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.806309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752b2b8-abf4-439b-903e-2c4ff78bcada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.807036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752b2b8-abf4-439b-903e-2c4ff78bcada None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.807490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752b2b8-abf4-439b-903e-2c4ff78bcada None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.807642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752b2b8-abf4-439b-903e-2c4ff78bcada None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.808879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752b2b8-abf4-439b-903e-2c4ff78bcada None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.810323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752b2b8-abf4-439b-903e-2c4ff78bcada None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.812144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 210/409] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.813323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752b2b8-abf4-439b-903e-2c4ff78bcada None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.914337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6f6b-9606-4d33-b328-3e63f9546a33 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.941760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.949217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752b2b8-abf4-439b-903e-2c4ff78bcada None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.978596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60638f9-96fe-4046-b3e0-1950fb32b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.980057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60638f9-96fe-4046-b3e0-1950fb32b0c3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.980057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60638f9-96fe-4046-b3e0-1950fb32b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.980057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60638f9-96fe-4046-b3e0-1950fb32b0c3 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.981716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60638f9-96fe-4046-b3e0-1950fb32b0c3 None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.982800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60638f9-96fe-4046-b3e0-1950fb32b0c3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.993110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 200/410] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.993110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ec17a-3dac-42d0-96a3-f98949640d82 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.993110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ec17a-3dac-42d0-96a3-f98949640d82 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.993110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ec17a-3dac-42d0-96a3-f98949640d82 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.993110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 201/411] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:23.993110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ec17a-3dac-42d0-96a3-f98949640d82 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.007311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edde7cd-d9d6-4343-a4c2-4b48ba23a1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.008034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edde7cd-d9d6-4343-a4c2-4b48ba23a1cd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.008905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edde7cd-d9d6-4343-a4c2-4b48ba23a1cd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.009183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edde7cd-d9d6-4343-a4c2-4b48ba23a1cd None admin] PATH_INFO: `/v3/groups/235d1e38862945178f2302909f55ffd3` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.010604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edde7cd-d9d6-4343-a4c2-4b48ba23a1cd None admin] RBAC: Authorizing `identity:get_group(group_id=235d1e38862945178f2302909f55ffd3)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.012093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edde7cd-d9d6-4343-a4c2-4b48ba23a1cd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.014378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 211/412] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/groups/235d1e38862945178f2302909f55ffd3 => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:24.015192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edde7cd-d9d6-4343-a4c2-4b48ba23a1cd None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.046110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:24.123223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ec17a-3dac-42d0-96a3-f98949640d82 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.151232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edde7cd-d9d6-4343-a4c2-4b48ba23a1cd None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.165235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2f1e9-9d4c-49d7-b2a0-742a84a8613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.165912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2f1e9-9d4c-49d7-b2a0-742a84a8613c None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.166198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2f1e9-9d4c-49d7-b2a0-742a84a8613c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.166479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2f1e9-9d4c-49d7-b2a0-742a84a8613c None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef/groups/25143406e241439aaeee829da5d69456/roles/597a1ee9b8e047e4b63712515f4994f0` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.169143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2f1e9-9d4c-49d7-b2a0-742a84a8613c None admin] RBAC: Authorizing `identity:create_grant(project_id=242f77755a624c91b449fbc88eeae5ef, group_id=25143406e241439aaeee829da5d69456, role_id=597a1ee9b8e047e4b63712515f4994f0)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.170603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2f1e9-9d4c-49d7-b2a0-742a84a8613c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.186814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 202/413] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Aug 18 20:34:23 2022] PUT /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef/groups/25143406e241439aaeee829da5d69456/roles/597a1ee9b8e047e4b63712515f4994f0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:24.186814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d91d3d-3798-47d7-a579-c424387a432f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.187091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d91d3d-3798-47d7-a579-c424387a432f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.187163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d91d3d-3798-47d7-a579-c424387a432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.204829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de363cf3-cd59-4418-a458-aa81a1191688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.205526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de363cf3-cd59-4418-a458-aa81a1191688 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.205806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de363cf3-cd59-4418-a458-aa81a1191688 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.206080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de363cf3-cd59-4418-a458-aa81a1191688 None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef/groups/25143406e241439aaeee829da5d69456/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.208220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de363cf3-cd59-4418-a458-aa81a1191688 None admin] RBAC: Authorizing `identity:create_grant(project_id=242f77755a624c91b449fbc88eeae5ef, group_id=25143406e241439aaeee829da5d69456, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.210064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de363cf3-cd59-4418-a458-aa81a1191688 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.212925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d3d91d3d-3798-47d7-a579-c424387a432f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:24.214882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d3d91d3d-3798-47d7-a579-c424387a432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:24.229049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 212/414] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Aug 18 20:34:24 2022] PUT /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef/groups/25143406e241439aaeee829da5d69456/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:24.230375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de363cf3-cd59-4418-a458-aa81a1191688 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.311258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:24.374606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 203/415] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:24.464131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de363cf3-cd59-4418-a458-aa81a1191688 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.516964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22f2ae-38a5-441f-bf25-3e98d8b81d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.518033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22f2ae-38a5-441f-bf25-3e98d8b81d0d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.518524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22f2ae-38a5-441f-bf25-3e98d8b81d0d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.519040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22f2ae-38a5-441f-bf25-3e98d8b81d0d None admin] PATH_INFO: `/v3/projects/0469791b573f4534aad86764e4849307` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.520407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22f2ae-38a5-441f-bf25-3e98d8b81d0d None admin] RBAC: Authorizing `identity:get_project(project_id=0469791b573f4534aad86764e4849307)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.523400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22f2ae-38a5-441f-bf25-3e98d8b81d0d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.525601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 213/416] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:24 2022] GET /identity/v3/projects/0469791b573f4534aad86764e4849307 => generated 344 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:24.532075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d91d3d-3798-47d7-a579-c424387a432f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.573595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:24.700670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d91d3d-3798-47d7-a579-c424387a432f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.727870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22f2ae-38a5-441f-bf25-3e98d8b81d0d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.751876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8de6e7-12a2-4020-ab82-170463deb690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.752567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8de6e7-12a2-4020-ab82-170463deb690 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.752851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8de6e7-12a2-4020-ab82-170463deb690 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.753127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8de6e7-12a2-4020-ab82-170463deb690 None admin] PATH_INFO: `/v3/projects/0469791b573f4534aad86764e4849307/groups/235d1e38862945178f2302909f55ffd3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.756102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8de6e7-12a2-4020-ab82-170463deb690 None admin] RBAC: Authorizing `identity:create_grant(project_id=0469791b573f4534aad86764e4849307, group_id=235d1e38862945178f2302909f55ffd3, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.758589 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8de6e7-12a2-4020-ab82-170463deb690 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.779934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 204/417] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Aug 18 20:34:24 2022] PUT /identity/v3/projects/0469791b573f4534aad86764e4849307/groups/235d1e38862945178f2302909f55ffd3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:24.779934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8259ce-f5d5-43ed-bbdb-793ce1e23092 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.779934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8259ce-f5d5-43ed-bbdb-793ce1e23092 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.779934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8259ce-f5d5-43ed-bbdb-793ce1e23092 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.785488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 205/418] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:24.788567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790630-2081-4daf-851d-723cdd138811 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.788913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790630-2081-4daf-851d-723cdd138811 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.789374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790630-2081-4daf-851d-723cdd138811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.813009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-db790630-2081-4daf-851d-723cdd138811 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:24.814260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-db790630-2081-4daf-851d-723cdd138811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:24.906101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 206/419] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:24.927898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:24.947925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22f2ae-38a5-441f-bf25-3e98d8b81d0d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.011048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74580de-a37d-40a2-a92f-940aebffa1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.012006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74580de-a37d-40a2-a92f-940aebffa1eb None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.012435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74580de-a37d-40a2-a92f-940aebffa1eb None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.012911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74580de-a37d-40a2-a92f-940aebffa1eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.024697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74580de-a37d-40a2-a92f-940aebffa1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-f74580de-a37d-40a2-a92f-940aebffa1eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:25.030154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:25.031303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:25.032335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:25.039124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 214/420] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:25.042855 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790630-2081-4daf-851d-723cdd138811 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.087165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.151897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790630-2081-4daf-851d-723cdd138811 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.189227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245f8d4-e409-47f7-8d30-f44b1e750e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.189849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245f8d4-e409-47f7-8d30-f44b1e750e57 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.190131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245f8d4-e409-47f7-8d30-f44b1e750e57 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.190403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245f8d4-e409-47f7-8d30-f44b1e750e57 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.191197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245f8d4-e409-47f7-8d30-f44b1e750e57 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:25.191548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245f8d4-e409-47f7-8d30-f44b1e750e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.193087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245f8d4-e409-47f7-8d30-f44b1e750e57 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.202777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 207/421] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:25.208347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74580de-a37d-40a2-a92f-940aebffa1eb None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.221456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245f8d4-e409-47f7-8d30-f44b1e750e57 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.327190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.353241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245f8d4-e409-47f7-8d30-f44b1e750e57 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.421094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74580de-a37d-40a2-a92f-940aebffa1eb None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.455573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb0e70-749a-4a80-932c-090050e0f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.456145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0e70-749a-4a80-932c-090050e0f87a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.456425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0e70-749a-4a80-932c-090050e0f87a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.456698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0e70-749a-4a80-932c-090050e0f87a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.459816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3c6b4-c047-46a3-b3b9-7e0846d82624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.460639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3c6b4-c047-46a3-b3b9-7e0846d82624 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.461068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3c6b4-c047-46a3-b3b9-7e0846d82624 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.461867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3c6b4-c047-46a3-b3b9-7e0846d82624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.482578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb0e70-749a-4a80-932c-090050e0f87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-dfbb0e70-749a-4a80-932c-090050e0f87a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:25.487437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:25.488622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:25.489634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:25.494056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.495225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 208/422] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:25.501124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb0e70-749a-4a80-932c-090050e0f87a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.550574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3c6b4-c047-46a3-b3b9-7e0846d82624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.552931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3c6b4-c047-46a3-b3b9-7e0846d82624 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.678017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 215/423] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:25.684550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3c6b4-c047-46a3-b3b9-7e0846d82624 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.733145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb0e70-749a-4a80-932c-090050e0f87a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.751122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.798540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3c6b4-c047-46a3-b3b9-7e0846d82624 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.809537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0225f8-210d-4675-b390-985235dbc3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.810208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0225f8-210d-4675-b390-985235dbc3e3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.810489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0225f8-210d-4675-b390-985235dbc3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.810776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0225f8-210d-4675-b390-985235dbc3e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.811699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0225f8-210d-4675-b390-985235dbc3e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:25.811817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0225f8-210d-4675-b390-985235dbc3e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.813099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0225f8-210d-4675-b390-985235dbc3e3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.818671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.830449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 209/424] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:25.836350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0225f8-210d-4675-b390-985235dbc3e3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.838382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1423b2d-e241-495d-8c49-7f2b6562a0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.839294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1423b2d-e241-495d-8c49-7f2b6562a0b9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.839736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1423b2d-e241-495d-8c49-7f2b6562a0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.840149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1423b2d-e241-495d-8c49-7f2b6562a0b9 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.841410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1423b2d-e241-495d-8c49-7f2b6562a0b9 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.843016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1423b2d-e241-495d-8c49-7f2b6562a0b9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.845087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 216/425] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:25.851111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1423b2d-e241-495d-8c49-7f2b6562a0b9 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.968615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1423b2d-e241-495d-8c49-7f2b6562a0b9 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.999243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.015468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353a48-a97c-4d5b-b5fb-9b88fefacb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.016906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353a48-a97c-4d5b-b5fb-9b88fefacb19 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.017383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353a48-a97c-4d5b-b5fb-9b88fefacb19 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.017998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353a48-a97c-4d5b-b5fb-9b88fefacb19 None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.019360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a353a48-a97c-4d5b-b5fb-9b88fefacb19 None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.021485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a353a48-a97c-4d5b-b5fb-9b88fefacb19 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.023873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 217/426] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:26.030223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353a48-a97c-4d5b-b5fb-9b88fefacb19 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.113396 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0225f8-210d-4675-b390-985235dbc3e3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.156226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112062b2-6da5-4b99-ae2e-641e0012c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.157618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112062b2-6da5-4b99-ae2e-641e0012c97e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.158087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112062b2-6da5-4b99-ae2e-641e0012c97e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.158564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112062b2-6da5-4b99-ae2e-641e0012c97e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.239460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.244818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112062b2-6da5-4b99-ae2e-641e0012c97e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.246714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112062b2-6da5-4b99-ae2e-641e0012c97e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.336824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353a48-a97c-4d5b-b5fb-9b88fefacb19 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.366751 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 210/427] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:34:26.379845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112062b2-6da5-4b99-ae2e-641e0012c97e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.420020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b3f9-bdfe-4eed-81ad-c8baa5e10e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.420638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b3f9-bdfe-4eed-81ad-c8baa5e10e45 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.420912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b3f9-bdfe-4eed-81ad-c8baa5e10e45 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.421179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b3f9-bdfe-4eed-81ad-c8baa5e10e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.421911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01b3f9-bdfe-4eed-81ad-c8baa5e10e45 None admin] RBAC: Adding query filter params (group.id=25143406e241439aaeee829da5d69456, role.id=b7551ed385954688a565792f95efda9c, scope.project.id=65e5d2374d6d489d9ce0f7c913737262) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:26.422212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01b3f9-bdfe-4eed-81ad-c8baa5e10e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.423727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01b3f9-bdfe-4eed-81ad-c8baa5e10e45 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.437369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 218/428] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/role_assignments?group.id=25143406e241439aaeee829da5d69456&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=b7551ed385954688a565792f95efda9c => generated 611 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:26.498627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d4ae-11fe-452e-aadc-7280c0f1567b None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.498627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d4ae-11fe-452e-aadc-7280c0f1567b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.498958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d4ae-11fe-452e-aadc-7280c0f1567b None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.500584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 219/429] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:26.512511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526177f-5d59-4b7a-b418-865b9338fce3 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.512783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526177f-5d59-4b7a-b418-865b9338fce3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.513043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526177f-5d59-4b7a-b418-865b9338fce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.533872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3526177f-5d59-4b7a-b418-865b9338fce3 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:26.535309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3526177f-5d59-4b7a-b418-865b9338fce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:26.542644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.550080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112062b2-6da5-4b99-ae2e-641e0012c97e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.622249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.638198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e1eaa-f247-47f4-9c0e-20f0c17bba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.638869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e1eaa-f247-47f4-9c0e-20f0c17bba22 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.639145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e1eaa-f247-47f4-9c0e-20f0c17bba22 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.639417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e1eaa-f247-47f4-9c0e-20f0c17bba22 None admin] PATH_INFO: `/v3/projects/65e5d2374d6d489d9ce0f7c913737262` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.640684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e1eaa-f247-47f4-9c0e-20f0c17bba22 None admin] RBAC: Authorizing `identity:get_project(project_id=65e5d2374d6d489d9ce0f7c913737262)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.641968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e1eaa-f247-47f4-9c0e-20f0c17bba22 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.643915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 211/430] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/projects/65e5d2374d6d489d9ce0f7c913737262 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:26.649861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e1eaa-f247-47f4-9c0e-20f0c17bba22 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.661079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 220/431] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:26.705944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119701-9c4f-4c12-92d0-15d7fc56c40e None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.706948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119701-9c4f-4c12-92d0-15d7fc56c40e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.707743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119701-9c4f-4c12-92d0-15d7fc56c40e None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.710678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 221/432] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:26.716453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f9ba-b796-4e39-ab2d-613791a49e97 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.716864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f9ba-b796-4e39-ab2d-613791a49e97 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.717248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f9ba-b796-4e39-ab2d-613791a49e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.737202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b7b7f9ba-b796-4e39-ab2d-613791a49e97 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:26.738550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b7b7f9ba-b796-4e39-ab2d-613791a49e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:26.773526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e1eaa-f247-47f4-9c0e-20f0c17bba22 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.823144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fba85c-afc8-476a-84a4-5442ba187277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.824341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fba85c-afc8-476a-84a4-5442ba187277 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.824794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fba85c-afc8-476a-84a4-5442ba187277 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.825230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fba85c-afc8-476a-84a4-5442ba187277 None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.826637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fba85c-afc8-476a-84a4-5442ba187277 None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.828106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 222/433] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:26.828561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fba85c-afc8-476a-84a4-5442ba187277 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.831014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 212/434] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:26.837975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7f9ba-b796-4e39-ab2d-613791a49e97 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.944425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7f9ba-b796-4e39-ab2d-613791a49e97 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.951938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fba85c-afc8-476a-84a4-5442ba187277 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.964381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.992962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e4dcc-7276-48ff-84d4-e2ab47c7430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.994346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4dcc-7276-48ff-84d4-e2ab47c7430a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.994850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4dcc-7276-48ff-84d4-e2ab47c7430a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.995505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4dcc-7276-48ff-84d4-e2ab47c7430a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.996293 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.997296 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e4dcc-7276-48ff-84d4-e2ab47c7430a None admin] RBAC: Adding query filter params (group.id=25143406e241439aaeee829da5d69456, role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=65e5d2374d6d489d9ce0f7c913737262) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:26.997819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e4dcc-7276-48ff-84d4-e2ab47c7430a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.999455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e4dcc-7276-48ff-84d4-e2ab47c7430a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.007775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 223/435] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/role_assignments?group.id=25143406e241439aaeee829da5d69456&scope.project.id=65e5d2374d6d489d9ce0f7c913737262&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:27.102557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fba85c-afc8-476a-84a4-5442ba187277 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.114442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e4dcc-7276-48ff-84d4-e2ab47c7430a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.148341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c97d1-f2c9-4ac1-a3e0-ea4529430f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.148985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c97d1-f2c9-4ac1-a3e0-ea4529430f15 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.149262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c97d1-f2c9-4ac1-a3e0-ea4529430f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.149531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c97d1-f2c9-4ac1-a3e0-ea4529430f15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.173817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c97d1-f2c9-4ac1-a3e0-ea4529430f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-a71c97d1-f2c9-4ac1-a3e0-ea4529430f15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:27.181284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:27.182256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:27.183104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 213/436] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:27.190609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c97d1-f2c9-4ac1-a3e0-ea4529430f15 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.243791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e4dcc-7276-48ff-84d4-e2ab47c7430a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.283344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31cb1f-b67d-4a4b-9ed8-0b1b27cb30d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.283978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31cb1f-b67d-4a4b-9ed8-0b1b27cb30d6 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.284244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31cb1f-b67d-4a4b-9ed8-0b1b27cb30d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.284521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31cb1f-b67d-4a4b-9ed8-0b1b27cb30d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.299378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31cb1f-b67d-4a4b-9ed8-0b1b27cb30d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-fd31cb1f-b67d-4a4b-9ed8-0b1b27cb30d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:27.304844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:27.305809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:27.306651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 224/437] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:27.309544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6665498-7742-41fe-8689-5c8e06402d23 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.309544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6665498-7742-41fe-8689-5c8e06402d23 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.309544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6665498-7742-41fe-8689-5c8e06402d23 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.313571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 225/438] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:27.313774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.314482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6665498-7742-41fe-8689-5c8e06402d23 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.318571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c97d1-f2c9-4ac1-a3e0-ea4529430f15 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.358999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917b93e-887e-468c-b8bb-c4da6150ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.360451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917b93e-887e-468c-b8bb-c4da6150ac88 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.360735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917b93e-887e-468c-b8bb-c4da6150ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.361016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917b93e-887e-468c-b8bb-c4da6150ac88 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.361695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917b93e-887e-468c-b8bb-c4da6150ac88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:27.362000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917b93e-887e-468c-b8bb-c4da6150ac88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.363479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917b93e-887e-468c-b8bb-c4da6150ac88 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.366465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.378837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 214/439] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:27.380444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f89cb-69f1-432f-a6e7-97f96e43e371 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.382167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f89cb-69f1-432f-a6e7-97f96e43e371 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.382637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f89cb-69f1-432f-a6e7-97f96e43e371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.401474 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-af2f89cb-69f1-432f-a6e7-97f96e43e371 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:27.403355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-af2f89cb-69f1-432f-a6e7-97f96e43e371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:27.449658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6665498-7742-41fe-8689-5c8e06402d23 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.485046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 215/440] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:27.485913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f89cb-69f1-432f-a6e7-97f96e43e371 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.497524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84bd34-339d-4b17-b5e3-57e87203df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.497849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84bd34-339d-4b17-b5e3-57e87203df1c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.498122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84bd34-339d-4b17-b5e3-57e87203df1c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.498519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84bd34-339d-4b17-b5e3-57e87203df1c None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.499273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84bd34-339d-4b17-b5e3-57e87203df1c None admin] RBAC: Adding query filter params (name=member) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:27.499574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84bd34-339d-4b17-b5e3-57e87203df1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.500961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84bd34-339d-4b17-b5e3-57e87203df1c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.510908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 226/441] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:27.516351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84bd34-339d-4b17-b5e3-57e87203df1c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.588248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.605970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f89cb-69f1-432f-a6e7-97f96e43e371 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.623593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.626834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84bd34-339d-4b17-b5e3-57e87203df1c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.645300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262a49d-d149-492e-9b9f-e827ccf98c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.645913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262a49d-d149-492e-9b9f-e827ccf98c0e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.646707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262a49d-d149-492e-9b9f-e827ccf98c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.647365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262a49d-d149-492e-9b9f-e827ccf98c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.664172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ebf8-280d-4370-b844-a127484f4c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.664776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ebf8-280d-4370-b844-a127484f4c98 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.665055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ebf8-280d-4370-b844-a127484f4c98 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.665323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ebf8-280d-4370-b844-a127484f4c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.719733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262a49d-d149-492e-9b9f-e827ccf98c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.721205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262a49d-d149-492e-9b9f-e827ccf98c0e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.738416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ebf8-280d-4370-b844-a127484f4c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.740579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ebf8-280d-4370-b844-a127484f4c98 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.809278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.823010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 216/442] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:27.823923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262a49d-d149-492e-9b9f-e827ccf98c0e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.840205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.848962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 227/443] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:34:27.850534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ebf8-280d-4370-b844-a127484f4c98 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.928997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262a49d-d149-492e-9b9f-e827ccf98c0e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.955727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ebf8-280d-4370-b844-a127484f4c98 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.967787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13824a71-be86-4602-82e6-b5c5b5b06f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.968428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13824a71-be86-4602-82e6-b5c5b5b06f3c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.968710 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13824a71-be86-4602-82e6-b5c5b5b06f3c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.968985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13824a71-be86-4602-82e6-b5c5b5b06f3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.981373 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13824a71-be86-4602-82e6-b5c5b5b06f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-13824a71-be86-4602-82e6-b5c5b5b06f3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:27.986719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:27.987741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:27.988550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 217/444] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:27.989237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13824a71-be86-4602-82e6-b5c5b5b06f3c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.996033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d655508-d9c7-48ab-a041-24e40948b5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.996849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d655508-d9c7-48ab-a041-24e40948b5fd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.997129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d655508-d9c7-48ab-a041-24e40948b5fd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.997418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d655508-d9c7-48ab-a041-24e40948b5fd None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.999256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d655508-d9c7-48ab-a041-24e40948b5fd None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:28.001723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d655508-d9c7-48ab-a041-24e40948b5fd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:28.009511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 228/445] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:28.009511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d655508-d9c7-48ab-a041-24e40948b5fd None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:28.058132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:28.086418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:28.111511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13824a71-be86-4602-82e6-b5c5b5b06f3c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:28.122564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d655508-d9c7-48ab-a041-24e40948b5fd None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:28.149381 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb510f7-0ac1-4289-a269-327d7d77e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:28.150110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb510f7-0ac1-4289-a269-327d7d77e71c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.150543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb510f7-0ac1-4289-a269-327d7d77e71c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.150852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb510f7-0ac1-4289-a269-327d7d77e71c None admin] PATH_INFO: `/v3/projects/242f77755a624c91b449fbc88eeae5ef` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.151986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb510f7-0ac1-4289-a269-327d7d77e71c None admin] RBAC: Authorizing `identity:get_project(project_id=242f77755a624c91b449fbc88eeae5ef)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:28.153445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb510f7-0ac1-4289-a269-327d7d77e71c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:28.155144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 218/446] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/projects/242f77755a624c91b449fbc88eeae5ef => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:28.155945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb510f7-0ac1-4289-a269-327d7d77e71c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:28.158954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39158047-8576-4f46-9e2e-f965e5f3a8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:28.159710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39158047-8576-4f46-9e2e-f965e5f3a8f4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.160013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39158047-8576-4f46-9e2e-f965e5f3a8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.160290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39158047-8576-4f46-9e2e-f965e5f3a8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.160964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39158047-8576-4f46-9e2e-f965e5f3a8f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:28.161269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39158047-8576-4f46-9e2e-f965e5f3a8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:28.163328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39158047-8576-4f46-9e2e-f965e5f3a8f4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:28.172276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 229/447] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:28.173524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39158047-8576-4f46-9e2e-f965e5f3a8f4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:28.279129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb510f7-0ac1-4289-a269-327d7d77e71c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:28.288302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39158047-8576-4f46-9e2e-f965e5f3a8f4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:28.296175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:28.315868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7dc21-0c4a-42e1-980a-45e6f7697838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:28.316501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7dc21-0c4a-42e1-980a-45e6f7697838 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.316784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7dc21-0c4a-42e1-980a-45e6f7697838 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.317068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7dc21-0c4a-42e1-980a-45e6f7697838 None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.319004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7dc21-0c4a-42e1-980a-45e6f7697838 None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:28.320529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7dc21-0c4a-42e1-980a-45e6f7697838 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:28.320812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:28.327918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 219/448] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:28 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:28.327918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7dc21-0c4a-42e1-980a-45e6f7697838 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:28.334314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c0c17-b443-4bfb-97c7-8e4240448a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:28.335518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c0c17-b443-4bfb-97c7-8e4240448a56 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.335518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c0c17-b443-4bfb-97c7-8e4240448a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.335962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c0c17-b443-4bfb-97c7-8e4240448a56 None admin] PATH_INFO: `/v3/groups/25143406e241439aaeee829da5d69456` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.337485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c0c17-b443-4bfb-97c7-8e4240448a56 None admin] RBAC: Authorizing `identity:get_group(group_id=25143406e241439aaeee829da5d69456)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:28.338897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c0c17-b443-4bfb-97c7-8e4240448a56 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:28.340524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 230/449] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:28 2022] GET /identity/v3/groups/25143406e241439aaeee829da5d69456 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:28.341233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c0c17-b443-4bfb-97c7-8e4240448a56 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:28.439500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7dc21-0c4a-42e1-980a-45e6f7697838 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:28.454358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c0c17-b443-4bfb-97c7-8e4240448a56 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:28.479016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e1f4f-578f-45f3-babe-85bd2f577701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:28.479625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e1f4f-578f-45f3-babe-85bd2f577701 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.479902 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e1f4f-578f-45f3-babe-85bd2f577701 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.480181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e1f4f-578f-45f3-babe-85bd2f577701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.493021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954cd67-fc7a-4811-8ae7-443be3341c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:28.493807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954cd67-fc7a-4811-8ae7-443be3341c8c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.494220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954cd67-fc7a-4811-8ae7-443be3341c8c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.494499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954cd67-fc7a-4811-8ae7-443be3341c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.495440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954cd67-fc7a-4811-8ae7-443be3341c8c None admin] RBAC: Adding query filter params (group.id=25143406e241439aaeee829da5d69456, role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=242f77755a624c91b449fbc88eeae5ef) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:28.495755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954cd67-fc7a-4811-8ae7-443be3341c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:28.497988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954cd67-fc7a-4811-8ae7-443be3341c8c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:28.504029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 231/450] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:28 2022] GET /identity/v3/role_assignments?group.id=25143406e241439aaeee829da5d69456&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:28.504823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954cd67-fc7a-4811-8ae7-443be3341c8c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:28.541500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:28.562793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e1f4f-578f-45f3-babe-85bd2f577701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:28.564316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e1f4f-578f-45f3-babe-85bd2f577701 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:28.613210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:28.675840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954cd67-fc7a-4811-8ae7-443be3341c8c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:28.701210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 220/451] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:28.706603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e1f4f-578f-45f3-babe-85bd2f577701 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:28.720092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad3bcd-b6d0-43f8-9375-edf8f24ff007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:28.721028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad3bcd-b6d0-43f8-9375-edf8f24ff007 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.721494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad3bcd-b6d0-43f8-9375-edf8f24ff007 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.721882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad3bcd-b6d0-43f8-9375-edf8f24ff007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.722627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad3bcd-b6d0-43f8-9375-edf8f24ff007 None admin] RBAC: Adding query filter params (group.id=25143406e241439aaeee829da5d69456, role.id=b7551ed385954688a565792f95efda9c, scope.project.id=242f77755a624c91b449fbc88eeae5ef) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:28.722986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad3bcd-b6d0-43f8-9375-edf8f24ff007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:28.725089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad3bcd-b6d0-43f8-9375-edf8f24ff007 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:28.731744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 232/452] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:28 2022] GET /identity/v3/role_assignments?group.id=25143406e241439aaeee829da5d69456&scope.project.id=242f77755a624c91b449fbc88eeae5ef&role.id=b7551ed385954688a565792f95efda9c => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:28.808642 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:28.832957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e1f4f-578f-45f3-babe-85bd2f577701 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:28.873677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cfc77-3444-40ce-b7e7-e2a7dd454d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:28.874246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cfc77-3444-40ce-b7e7-e2a7dd454d09 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.874529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cfc77-3444-40ce-b7e7-e2a7dd454d09 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.874829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cfc77-3444-40ce-b7e7-e2a7dd454d09 None admin] PATH_INFO: `/v3/projects/0469791b573f4534aad86764e4849307` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.875970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cfc77-3444-40ce-b7e7-e2a7dd454d09 None admin] RBAC: Authorizing `identity:get_project(project_id=0469791b573f4534aad86764e4849307)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:28.877431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cfc77-3444-40ce-b7e7-e2a7dd454d09 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:28.879261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 221/453] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:34:28 2022] GET /identity/v3/projects/0469791b573f4534aad86764e4849307 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:28.886214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad3bcd-b6d0-43f8-9375-edf8f24ff007 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:29.007043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad3bcd-b6d0-43f8-9375-edf8f24ff007 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:29.037563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:29.049754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176b19-2855-4c48-9986-1deade5fb6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:29.050385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176b19-2855-4c48-9986-1deade5fb6d1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:29.050662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176b19-2855-4c48-9986-1deade5fb6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:29.050979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176b19-2855-4c48-9986-1deade5fb6d1 None admin] PATH_INFO: `/v3/groups/235d1e38862945178f2302909f55ffd3` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:29.052090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59176b19-2855-4c48-9986-1deade5fb6d1 None admin] RBAC: Authorizing `identity:get_group(group_id=235d1e38862945178f2302909f55ffd3)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:29.054055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59176b19-2855-4c48-9986-1deade5fb6d1 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:29.055704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 233/454] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Aug 18 20:34:28 2022] GET /identity/v3/groups/235d1e38862945178f2302909f55ffd3 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:29.061914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cfc77-3444-40ce-b7e7-e2a7dd454d09 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:29.176499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cfc77-3444-40ce-b7e7-e2a7dd454d09 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:29.215265 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505f003-e1e7-4a0b-b128-0e9d5eca23a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:29.215889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505f003-e1e7-4a0b-b128-0e9d5eca23a3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:29.216173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505f003-e1e7-4a0b-b128-0e9d5eca23a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:29.216456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505f003-e1e7-4a0b-b128-0e9d5eca23a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:29.217191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505f003-e1e7-4a0b-b128-0e9d5eca23a3 None admin] RBAC: Adding query filter params (group.id=235d1e38862945178f2302909f55ffd3, role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=0469791b573f4534aad86764e4849307) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:29.217499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505f003-e1e7-4a0b-b128-0e9d5eca23a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:29.219002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505f003-e1e7-4a0b-b128-0e9d5eca23a3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:29.226221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 222/455] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Aug 18 20:34:29 2022] GET /identity/v3/role_assignments?group.id=235d1e38862945178f2302909f55ffd3&scope.project.id=0469791b573f4534aad86764e4849307&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:31.713783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02e10-8c11-4bf4-ac42-c6d4c9ea67fd None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.714790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02e10-8c11-4bf4-ac42-c6d4c9ea67fd None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.715261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02e10-8c11-4bf4-ac42-c6d4c9ea67fd None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.717046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 234/456] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:31.722841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aef5a-1753-400e-958a-09a4858a4773 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.723716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aef5a-1753-400e-958a-09a4858a4773 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.724762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aef5a-1753-400e-958a-09a4858a4773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.747830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-cf5aef5a-1753-400e-958a-09a4858a4773 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:31.749080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cf5aef5a-1753-400e-958a-09a4858a4773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:31.764292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:31.840709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 223/457] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:31.959046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7ef5-5760-4ccb-ab12-72c0afb8ed43 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.959939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7ef5-5760-4ccb-ab12-72c0afb8ed43 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.960424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7ef5-5760-4ccb-ab12-72c0afb8ed43 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.961980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 235/458] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:31.967359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b3a8d-c5c4-413f-a6dd-52095e451d26 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.967899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b3a8d-c5c4-413f-a6dd-52095e451d26 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.968402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b3a8d-c5c4-413f-a6dd-52095e451d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.995778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-938b3a8d-c5c4-413f-a6dd-52095e451d26 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:31.997323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-938b3a8d-c5c4-413f-a6dd-52095e451d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:32.008602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bc2bc-d959-4e9a-b1a9-2040b351dab2 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.008913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bc2bc-d959-4e9a-b1a9-2040b351dab2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.009164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bc2bc-d959-4e9a-b1a9-2040b351dab2 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.011279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 236/459] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:32.015927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6cd7a-c3c5-40c5-bd3d-c296adca7399 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.016212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6cd7a-c3c5-40c5-bd3d-c296adca7399 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.016482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6cd7a-c3c5-40c5-bd3d-c296adca7399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.055400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-81b6cd7a-c3c5-40c5-bd3d-c296adca7399 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:32.056939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-81b6cd7a-c3c5-40c5-bd3d-c296adca7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:32.114581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 224/460] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:32.169317 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 237/461] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:32.263398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b3a8d-c5c4-413f-a6dd-52095e451d26 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.376352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.410594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b3a8d-c5c4-413f-a6dd-52095e451d26 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.455619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e942ea-2eaf-4e24-b0e0-a50fe107bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.456266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e942ea-2eaf-4e24-b0e0-a50fe107bf87 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.456547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e942ea-2eaf-4e24-b0e0-a50fe107bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.456821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e942ea-2eaf-4e24-b0e0-a50fe107bf87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.468585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6cd7a-c3c5-40c5-bd3d-c296adca7399 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.473613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e942ea-2eaf-4e24-b0e0-a50fe107bf87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.475402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e942ea-2eaf-4e24-b0e0-a50fe107bf87 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-15e942ea-2eaf-4e24-b0e0-a50fe107bf87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:32.491651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:32.492649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:32.493499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:32.493499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:32.493499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:32.493499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 225/462] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:32.494342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02828120-18e4-4548-9daf-536d4c8db896 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.494629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02828120-18e4-4548-9daf-536d4c8db896 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.494934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02828120-18e4-4548-9daf-536d4c8db896 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.496399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 226/463] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:32.497163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02828120-18e4-4548-9daf-536d4c8db896 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.591055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6cd7a-c3c5-40c5-bd3d-c296adca7399 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.618151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02828120-18e4-4548-9daf-536d4c8db896 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.620271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.636221 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174286-019d-4c58-b723-dae69e1cdc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.637237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174286-019d-4c58-b723-dae69e1cdc63 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.637516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174286-019d-4c58-b723-dae69e1cdc63 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.637785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174286-019d-4c58-b723-dae69e1cdc63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.647005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.652713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174286-019d-4c58-b723-dae69e1cdc63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.654169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174286-019d-4c58-b723-dae69e1cdc63 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.656302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440d61b-6712-49e3-a342-ac2285caf703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.657235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440d61b-6712-49e3-a342-ac2285caf703 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.657512 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440d61b-6712-49e3-a342-ac2285caf703 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.657782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440d61b-6712-49e3-a342-ac2285caf703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-45174286-019d-4c58-b723-dae69e1cdc63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:32.669250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:32.670230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:32.671895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:32.671895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:32.671895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:32.672095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440d61b-6712-49e3-a342-ac2285caf703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.672256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 238/464] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:32.672328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440d61b-6712-49e3-a342-ac2285caf703 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.672394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174286-019d-4c58-b723-dae69e1cdc63 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-8440d61b-6712-49e3-a342-ac2285caf703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:32.688994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:32.689994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:32.691423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:32.691423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:32.691423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:32.691423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 227/465] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:32.691423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408af368-f2ae-4a0d-ac94-75ef8ac7c8e4 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.691717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408af368-f2ae-4a0d-ac94-75ef8ac7c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.691803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408af368-f2ae-4a0d-ac94-75ef8ac7c8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.712509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-408af368-f2ae-4a0d-ac94-75ef8ac7c8e4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:32.713726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-408af368-f2ae-4a0d-ac94-75ef8ac7c8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:32.785980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 228/466] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:32.787969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408af368-f2ae-4a0d-ac94-75ef8ac7c8e4 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.802570 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174286-019d-4c58-b723-dae69e1cdc63 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.842853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849570c-6c75-4bb2-b1c6-cc4eca043e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.843376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849570c-6c75-4bb2-b1c6-cc4eca043e46 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.843650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849570c-6c75-4bb2-b1c6-cc4eca043e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.843921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849570c-6c75-4bb2-b1c6-cc4eca043e46 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.844625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849570c-6c75-4bb2-b1c6-cc4eca043e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:32.844928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849570c-6c75-4bb2-b1c6-cc4eca043e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.846416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849570c-6c75-4bb2-b1c6-cc4eca043e46 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.860929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 239/467] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:32.861986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849570c-6c75-4bb2-b1c6-cc4eca043e46 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.904594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.936516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408af368-f2ae-4a0d-ac94-75ef8ac7c8e4 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.951652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.978537 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849570c-6c75-4bb2-b1c6-cc4eca043e46 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.991816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac67ca-9716-4307-b07c-00a404503c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.993215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac67ca-9716-4307-b07c-00a404503c58 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.993955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac67ca-9716-4307-b07c-00a404503c58 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.994434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac67ca-9716-4307-b07c-00a404503c58 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.995692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac67ca-9716-4307-b07c-00a404503c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:32.996708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac67ca-9716-4307-b07c-00a404503c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.998897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac67ca-9716-4307-b07c-00a404503c58 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.018988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb37c9-4716-40af-a99e-e7b9771a2639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.019596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb37c9-4716-40af-a99e-e7b9771a2639 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.019867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb37c9-4716-40af-a99e-e7b9771a2639 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.020268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb37c9-4716-40af-a99e-e7b9771a2639 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.021004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb37c9-4716-40af-a99e-e7b9771a2639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:33.021307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb37c9-4716-40af-a99e-e7b9771a2639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.022689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb37c9-4716-40af-a99e-e7b9771a2639 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.026590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 229/468] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:33.027794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac67ca-9716-4307-b07c-00a404503c58 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.040041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 240/469] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:33.041026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb37c9-4716-40af-a99e-e7b9771a2639 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.140565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac67ca-9716-4307-b07c-00a404503c58 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.151142 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.157910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb37c9-4716-40af-a99e-e7b9771a2639 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.176712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598c3bd-95e3-4959-971b-c94dcd8e0a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.177440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598c3bd-95e3-4959-971b-c94dcd8e0a6e None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.177716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598c3bd-95e3-4959-971b-c94dcd8e0a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.177985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598c3bd-95e3-4959-971b-c94dcd8e0a6e None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.178691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598c3bd-95e3-4959-971b-c94dcd8e0a6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.180267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598c3bd-95e3-4959-971b-c94dcd8e0a6e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.193566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5b1f2-8b00-49bb-8a23-7edcc8094e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.194723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5b1f2-8b00-49bb-8a23-7edcc8094e88 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.195006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5b1f2-8b00-49bb-8a23-7edcc8094e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.195339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5b1f2-8b00-49bb-8a23-7edcc8094e88 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.196053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5b1f2-8b00-49bb-8a23-7edcc8094e88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.197742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5b1f2-8b00-49bb-8a23-7edcc8094e88 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.203538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 230/470] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:33 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:33.204538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598c3bd-95e3-4959-971b-c94dcd8e0a6e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.226419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 241/471] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:33 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:33.227675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5b1f2-8b00-49bb-8a23-7edcc8094e88 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.284403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.424297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5b1f2-8b00-49bb-8a23-7edcc8094e88 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.444170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598c3bd-95e3-4959-971b-c94dcd8e0a6e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.468457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f084b0-ec58-40ed-a3aa-a207c35a85a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.469105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f084b0-ec58-40ed-a3aa-a207c35a85a2 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.469383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f084b0-ec58-40ed-a3aa-a207c35a85a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.469657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f084b0-ec58-40ed-a3aa-a207c35a85a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.483531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f084b0-ec58-40ed-a3aa-a207c35a85a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.485008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f084b0-ec58-40ed-a3aa-a207c35a85a2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.492018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b2031-fbf8-4ba2-a558-39abd88dc577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.492688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2031-fbf8-4ba2-a558-39abd88dc577 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.492973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2031-fbf8-4ba2-a558-39abd88dc577 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.493246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2031-fbf8-4ba2-a558-39abd88dc577 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.493892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b2031-fbf8-4ba2-a558-39abd88dc577 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.495399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b2031-fbf8-4ba2-a558-39abd88dc577 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-48f084b0-ec58-40ed-a3aa-a207c35a85a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:33.502521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:33.503461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:33.504783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:33.504783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:33.504783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:33.504783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 242/472] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:33.507754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836d426-9331-4cbc-9cf4-631194b8a7e2 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.508693 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836d426-9331-4cbc-9cf4-631194b8a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.508978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836d426-9331-4cbc-9cf4-631194b8a7e2 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.510671 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 243/473] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:33.511946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836d426-9331-4cbc-9cf4-631194b8a7e2 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.517055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.522914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 231/474] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:33 2022] POST /identity/v3/users => generated 248 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:33.524178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646cf84-7441-4de1-8385-702684b668bd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.524509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646cf84-7441-4de1-8385-702684b668bd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.524784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646cf84-7441-4de1-8385-702684b668bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.559965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a646cf84-7441-4de1-8385-702684b668bd None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:33.561198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a646cf84-7441-4de1-8385-702684b668bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:33.679423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 232/475] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:33.689162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836d426-9331-4cbc-9cf4-631194b8a7e2 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.740209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922ac6-74f3-487b-9519-8e6fe4505832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.741027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922ac6-74f3-487b-9519-8e6fe4505832 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.741306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922ac6-74f3-487b-9519-8e6fe4505832 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.741577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922ac6-74f3-487b-9519-8e6fe4505832 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.742273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df922ac6-74f3-487b-9519-8e6fe4505832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:33.742579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df922ac6-74f3-487b-9519-8e6fe4505832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.744026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df922ac6-74f3-487b-9519-8e6fe4505832 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.757458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 244/476] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:33.762988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646cf84-7441-4de1-8385-702684b668bd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.788708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.901218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646cf84-7441-4de1-8385-702684b668bd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.937271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80cd2a-c2fc-4380-9d18-3374fddfd1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.938161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80cd2a-c2fc-4380-9d18-3374fddfd1cf None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.938613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80cd2a-c2fc-4380-9d18-3374fddfd1cf None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.939083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80cd2a-c2fc-4380-9d18-3374fddfd1cf None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.939887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80cd2a-c2fc-4380-9d18-3374fddfd1cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.941547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80cd2a-c2fc-4380-9d18-3374fddfd1cf None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.974084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 233/477] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:33 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:34.028466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922ac6-74f3-487b-9519-8e6fe4505832 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.125251 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:34.172751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922ac6-74f3-487b-9519-8e6fe4505832 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.207122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.207647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.207921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.208693 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.209720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.211111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.220430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.sql.core [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 20:34:34.220430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 20:34:34.220430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [parameters: {'id': 'a1c743e087d04a4b8c15517f98f461f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 20:34:34.220430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result.read() Aug 18 20:34:34.237954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return ref.to_dict() Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:34:34.238959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application yield resource Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise self.value Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application session.commit() Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:34:34.240180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:34:34.241147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:34:34.242058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result.read() Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:34:34.244256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [parameters: {'id': 'a1c743e087d04a4b8c15517f98f461f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:34.246207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 20:34:34.248227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:34.250237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 245/478] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Aug 18 20:34:34 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:34.256123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80cd2a-c2fc-4380-9d18-3374fddfd1cf None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.329599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:34.369395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80cd2a-c2fc-4380-9d18-3374fddfd1cf None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.409700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d39232-967f-4456-ba8e-621f36bb7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.410413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39232-967f-4456-ba8e-621f36bb7f16 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.410698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39232-967f-4456-ba8e-621f36bb7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.411008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39232-967f-4456-ba8e-621f36bb7f16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.424280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d39232-967f-4456-ba8e-621f36bb7f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-46d39232-967f-4456-ba8e-621f36bb7f16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:34.430689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:34.431601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:34.432411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 234/479] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:34.437844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.563391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b193ac-e383-44ee-af1c-ec1d7cd5d2a8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.601307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:34.620282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0a594-0812-4253-8d2b-0362051ccefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.621121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0a594-0812-4253-8d2b-0362051ccefe None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.621406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0a594-0812-4253-8d2b-0362051ccefe None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.621757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0a594-0812-4253-8d2b-0362051ccefe None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.622517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0a594-0812-4253-8d2b-0362051ccefe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:34.622841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0a594-0812-4253-8d2b-0362051ccefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.624421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0a594-0812-4253-8d2b-0362051ccefe None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.635052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 246/480] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:35.534487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e45bf-12c5-4049-9d96-accff9782880 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.535573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e45bf-12c5-4049-9d96-accff9782880 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.536070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e45bf-12c5-4049-9d96-accff9782880 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.538556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 235/481] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:35.548478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d46ad-1d61-42ae-889c-0af5c64a66a3 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.549386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d46ad-1d61-42ae-889c-0af5c64a66a3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.549854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d46ad-1d61-42ae-889c-0af5c64a66a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.571883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-4e4d46ad-1d61-42ae-889c-0af5c64a66a3 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:35.573105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4e4d46ad-1d61-42ae-889c-0af5c64a66a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:35.646388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 247/482] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:35.729458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf85a-0152-4e9e-81ee-169ebc4bc74b None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.730004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf85a-0152-4e9e-81ee-169ebc4bc74b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.730419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf85a-0152-4e9e-81ee-169ebc4bc74b None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.732182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 236/483] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:35.738347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639a0e6-9918-414f-9088-fcd0d3afcebf None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.738629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639a0e6-9918-414f-9088-fcd0d3afcebf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.738934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639a0e6-9918-414f-9088-fcd0d3afcebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.773202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5639a0e6-9918-414f-9088-fcd0d3afcebf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:35.775002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5639a0e6-9918-414f-9088-fcd0d3afcebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:35.862173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 248/484] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:35.991908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c305916-79ad-4541-a9d6-02f82f3277ca None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.992496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c305916-79ad-4541-a9d6-02f82f3277ca None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.992964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c305916-79ad-4541-a9d6-02f82f3277ca None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.994649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 237/485] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:36.000146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5a8e-7d63-41f4-8168-95762819bbf0 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.000542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5a8e-7d63-41f4-8168-95762819bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.001046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5a8e-7d63-41f4-8168-95762819bbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.024632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-936a5a8e-7d63-41f4-8168-95762819bbf0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:36.025840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-936a5a8e-7d63-41f4-8168-95762819bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:36.089133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.115761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 249/486] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:36.152373 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c305916-79ad-4541-a9d6-02f82f3277ca None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.206689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5a8e-7d63-41f4-8168-95762819bbf0 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.329708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c305916-79ad-4541-a9d6-02f82f3277ca None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.362998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.378182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313766d-35e3-4733-bc1f-f1db637d2a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.378750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313766d-35e3-4733-bc1f-f1db637d2a49 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.379332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313766d-35e3-4733-bc1f-f1db637d2a49 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.379332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313766d-35e3-4733-bc1f-f1db637d2a49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.400994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5a8e-7d63-41f4-8168-95762819bbf0 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.402786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313766d-35e3-4733-bc1f-f1db637d2a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-7313766d-35e3-4733-bc1f-f1db637d2a49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:36.415378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:36.416364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:36.417171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:36.419892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 238/487] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:36.425828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313766d-35e3-4733-bc1f-f1db637d2a49 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.451156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00909-f3e4-408a-9b76-756120e265d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.451803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00909-f3e4-408a-9b76-756120e265d7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.452085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00909-f3e4-408a-9b76-756120e265d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.452359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00909-f3e4-408a-9b76-756120e265d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.463716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb00909-f3e4-408a-9b76-756120e265d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-5eb00909-f3e4-408a-9b76-756120e265d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:36.468510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:36.469467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:36.470277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:36.475137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 250/488] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:36.476035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00909-f3e4-408a-9b76-756120e265d7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.523947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.554610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313766d-35e3-4733-bc1f-f1db637d2a49 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.591742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00909-f3e4-408a-9b76-756120e265d7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.599677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715e416-9c5c-4393-a8a2-dd61601d3806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.600303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715e416-9c5c-4393-a8a2-dd61601d3806 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.600591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715e416-9c5c-4393-a8a2-dd61601d3806 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.601271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715e416-9c5c-4393-a8a2-dd61601d3806 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.601596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715e416-9c5c-4393-a8a2-dd61601d3806 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:36.601904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715e416-9c5c-4393-a8a2-dd61601d3806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:36.603402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715e416-9c5c-4393-a8a2-dd61601d3806 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:36.612628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 239/489] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:36.613511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715e416-9c5c-4393-a8a2-dd61601d3806 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.633021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d96760-28e0-4ae6-92fe-9571b555535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.633819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d96760-28e0-4ae6-92fe-9571b555535d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.634098 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d96760-28e0-4ae6-92fe-9571b555535d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.634368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d96760-28e0-4ae6-92fe-9571b555535d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.645341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d96760-28e0-4ae6-92fe-9571b555535d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-95d96760-28e0-4ae6-92fe-9571b555535d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:36.651063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:36.651956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:36.652767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 251/490] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:36.654203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b924a6-6574-4f01-86f3-100a30be1e00 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.654203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b924a6-6574-4f01-86f3-100a30be1e00 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.654203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b924a6-6574-4f01-86f3-100a30be1e00 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.655533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 252/491] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:36.656172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b924a6-6574-4f01-86f3-100a30be1e00 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.680280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.738244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715e416-9c5c-4393-a8a2-dd61601d3806 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.771854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.776326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b924a6-6574-4f01-86f3-100a30be1e00 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.777646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5451850-fdc7-4268-a38f-aa42968d63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.778259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5451850-fdc7-4268-a38f-aa42968d63b9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.778542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5451850-fdc7-4268-a38f-aa42968d63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.778843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5451850-fdc7-4268-a38f-aa42968d63b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.779506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5451850-fdc7-4268-a38f-aa42968d63b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:36.779807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5451850-fdc7-4268-a38f-aa42968d63b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:36.781205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5451850-fdc7-4268-a38f-aa42968d63b9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:36.794378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 240/492] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:36.794378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c54c-bbdf-4d9a-9fa0-bc014d3123e5 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.794378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c54c-bbdf-4d9a-9fa0-bc014d3123e5 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.794378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c54c-bbdf-4d9a-9fa0-bc014d3123e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.810211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-64c8c54c-bbdf-4d9a-9fa0-bc014d3123e5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:36.811458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-64c8c54c-bbdf-4d9a-9fa0-bc014d3123e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:36.823515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41118c-b2a4-4737-adc3-07c1eee8e362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.824161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41118c-b2a4-4737-adc3-07c1eee8e362 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.824441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41118c-b2a4-4737-adc3-07c1eee8e362 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.824722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41118c-b2a4-4737-adc3-07c1eee8e362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.836114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41118c-b2a4-4737-adc3-07c1eee8e362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:36.837583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41118c-b2a4-4737-adc3-07c1eee8e362 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-6e41118c-b2a4-4737-adc3-07c1eee8e362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:36.852276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:36.853209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:36.854064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:36.854064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:36.854064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:36.854064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 253/493] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:36.854277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41118c-b2a4-4737-adc3-07c1eee8e362 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.888640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 241/494] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:36.889427 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c54c-bbdf-4d9a-9fa0-bc014d3123e5 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.959487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.984766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41118c-b2a4-4737-adc3-07c1eee8e362 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.022951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824031fd-6486-448a-9694-d7a2159832d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.024090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824031fd-6486-448a-9694-d7a2159832d8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.024871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824031fd-6486-448a-9694-d7a2159832d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.025602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824031fd-6486-448a-9694-d7a2159832d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.026593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824031fd-6486-448a-9694-d7a2159832d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:37.027204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824031fd-6486-448a-9694-d7a2159832d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.029428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824031fd-6486-448a-9694-d7a2159832d8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.030579 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c54c-bbdf-4d9a-9fa0-bc014d3123e5 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.045566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 254/495] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:37.047136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824031fd-6486-448a-9694-d7a2159832d8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.068482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.075451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdb969-901c-40f5-ad5b-d5843160836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.076233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdb969-901c-40f5-ad5b-d5843160836a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.076586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdb969-901c-40f5-ad5b-d5843160836a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.076982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdb969-901c-40f5-ad5b-d5843160836a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.089644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdb969-901c-40f5-ad5b-d5843160836a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.091274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdb969-901c-40f5-ad5b-d5843160836a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-9fcdb969-901c-40f5-ad5b-d5843160836a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:37.108571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.109559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:37.110425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:37.110425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:37.110425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:37.114796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 242/496] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:37.115885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdb969-901c-40f5-ad5b-d5843160836a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.174339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824031fd-6486-448a-9694-d7a2159832d8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.211684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bac49-1825-44c6-a87b-1ab291760281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.212294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bac49-1825-44c6-a87b-1ab291760281 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.212573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bac49-1825-44c6-a87b-1ab291760281 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.212843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bac49-1825-44c6-a87b-1ab291760281 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.213483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bac49-1825-44c6-a87b-1ab291760281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:37.213786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bac49-1825-44c6-a87b-1ab291760281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.215185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bac49-1825-44c6-a87b-1ab291760281 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.228200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 255/497] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:37.228968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bac49-1825-44c6-a87b-1ab291760281 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.235755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.243954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdb969-901c-40f5-ad5b-d5843160836a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.282270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac731-ad3d-41fe-a3bd-81c079e9b967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.282944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac731-ad3d-41fe-a3bd-81c079e9b967 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.283225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac731-ad3d-41fe-a3bd-81c079e9b967 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.283499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac731-ad3d-41fe-a3bd-81c079e9b967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.295112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ac731-ad3d-41fe-a3bd-81c079e9b967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.296592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ac731-ad3d-41fe-a3bd-81c079e9b967 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.308231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ec8ac731-ad3d-41fe-a3bd-81c079e9b967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:37.312026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.313110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:37.314212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:37.314212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:37.314212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:37.314212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 243/498] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:37.315617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac731-ad3d-41fe-a3bd-81c079e9b967 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.340806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bac49-1825-44c6-a87b-1ab291760281 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.382497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80066acd-abed-413d-9c4a-82fa248edf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.383161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80066acd-abed-413d-9c4a-82fa248edf93 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.383704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80066acd-abed-413d-9c4a-82fa248edf93 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.383970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80066acd-abed-413d-9c4a-82fa248edf93 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.384625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80066acd-abed-413d-9c4a-82fa248edf93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:37.384927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80066acd-abed-413d-9c4a-82fa248edf93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.386304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80066acd-abed-413d-9c4a-82fa248edf93 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.401753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 256/499] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:37.402303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80066acd-abed-413d-9c4a-82fa248edf93 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.435597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac731-ad3d-41fe-a3bd-81c079e9b967 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.469402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ee940-7349-4a44-b60e-11860ae39677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.470022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee940-7349-4a44-b60e-11860ae39677 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.470295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee940-7349-4a44-b60e-11860ae39677 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.470561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee940-7349-4a44-b60e-11860ae39677 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.480820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ee940-7349-4a44-b60e-11860ae39677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-172ee940-7349-4a44-b60e-11860ae39677 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:37.485898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.487042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 244/500] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:37.488025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ee940-7349-4a44-b60e-11860ae39677 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.497864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.510362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80066acd-abed-413d-9c4a-82fa248edf93 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.545100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a0a9-abe4-4e23-ad98-40926268f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.545729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a0a9-abe4-4e23-ad98-40926268f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.546037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a0a9-abe4-4e23-ad98-40926268f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.546295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a0a9-abe4-4e23-ad98-40926268f9c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.548198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.555902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5a0a9-abe4-4e23-ad98-40926268f9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.557376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5a0a9-abe4-4e23-ad98-40926268f9c5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-d1d5a0a9-abe4-4e23-ad98-40926268f9c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:37.571058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.572052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 257/501] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:37.572983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a0a9-abe4-4e23-ad98-40926268f9c5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.599660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ee940-7349-4a44-b60e-11860ae39677 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.633137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a536a-fc10-4dea-a40c-e4004422eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.633991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a536a-fc10-4dea-a40c-e4004422eaae None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.634274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a536a-fc10-4dea-a40c-e4004422eaae None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.634543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a536a-fc10-4dea-a40c-e4004422eaae None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.635209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a536a-fc10-4dea-a40c-e4004422eaae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:37.635509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a536a-fc10-4dea-a40c-e4004422eaae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.636889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a536a-fc10-4dea-a40c-e4004422eaae None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.649193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 245/502] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:37.650632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47ea3a-1561-40af-9b7d-c3c44fb58548 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.651125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47ea3a-1561-40af-9b7d-c3c44fb58548 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.651545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47ea3a-1561-40af-9b7d-c3c44fb58548 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.653150 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 246/503] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:37.653985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47ea3a-1561-40af-9b7d-c3c44fb58548 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.681331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a0a9-abe4-4e23-ad98-40926268f9c5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.713831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652012d-6904-4069-94d2-1812b546e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.714379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652012d-6904-4069-94d2-1812b546e01c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.714660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652012d-6904-4069-94d2-1812b546e01c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.714955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652012d-6904-4069-94d2-1812b546e01c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.724480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652012d-6904-4069-94d2-1812b546e01c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.726371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652012d-6904-4069-94d2-1812b546e01c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.727580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-e652012d-6904-4069-94d2-1812b546e01c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:37.738096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.739103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:37.740721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 258/504] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:37.741309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652012d-6904-4069-94d2-1812b546e01c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.769103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47ea3a-1561-40af-9b7d-c3c44fb58548 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.797790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.803878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69538168-d638-4234-8332-3534b8514346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.804478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538168-d638-4234-8332-3534b8514346 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.804755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538168-d638-4234-8332-3534b8514346 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.805022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538168-d638-4234-8332-3534b8514346 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.805684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69538168-d638-4234-8332-3534b8514346 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:37.806199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69538168-d638-4234-8332-3534b8514346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.807398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69538168-d638-4234-8332-3534b8514346 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.815399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 247/505] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:37.816187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69538168-d638-4234-8332-3534b8514346 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.844307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652012d-6904-4069-94d2-1812b546e01c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.879369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdf90f-fd04-4ec5-8ff0-a179f4f74498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.880027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdf90f-fd04-4ec5-8ff0-a179f4f74498 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.880305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdf90f-fd04-4ec5-8ff0-a179f4f74498 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.883088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdf90f-fd04-4ec5-8ff0-a179f4f74498 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.883088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdf90f-fd04-4ec5-8ff0-a179f4f74498 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:37.883088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdf90f-fd04-4ec5-8ff0-a179f4f74498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.883637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdf90f-fd04-4ec5-8ff0-a179f4f74498 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.920757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69538168-d638-4234-8332-3534b8514346 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.922336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 259/506] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:37.924312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716024-ccad-4a54-8dd3-8aaa4bb40a25 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.924312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716024-ccad-4a54-8dd3-8aaa4bb40a25 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.924312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716024-ccad-4a54-8dd3-8aaa4bb40a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.942980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-6e716024-ccad-4a54-8dd3-8aaa4bb40a25 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:37.944593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6e716024-ccad-4a54-8dd3-8aaa4bb40a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:37.951239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.960739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6818705-1b95-47f2-a0bd-090d78e7b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.961373 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6818705-1b95-47f2-a0bd-090d78e7b696 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.961648 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6818705-1b95-47f2-a0bd-090d78e7b696 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.961913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6818705-1b95-47f2-a0bd-090d78e7b696 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.969384 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6818705-1b95-47f2-a0bd-090d78e7b696 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.970800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6818705-1b95-47f2-a0bd-090d78e7b696 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-c6818705-1b95-47f2-a0bd-090d78e7b696 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:37.986046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.987183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 248/507] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:37.988135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6818705-1b95-47f2-a0bd-090d78e7b696 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.021104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 260/508] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:38.022045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e716024-ccad-4a54-8dd3-8aaa4bb40a25 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.075006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.102711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6818705-1b95-47f2-a0bd-090d78e7b696 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.141463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b46676-fec0-4fd5-a87a-93053388799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.142219 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b46676-fec0-4fd5-a87a-93053388799d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.142498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b46676-fec0-4fd5-a87a-93053388799d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.142774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b46676-fec0-4fd5-a87a-93053388799d None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.143597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b46676-fec0-4fd5-a87a-93053388799d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:38.143929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b46676-fec0-4fd5-a87a-93053388799d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.146085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b46676-fec0-4fd5-a87a-93053388799d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.147632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e716024-ccad-4a54-8dd3-8aaa4bb40a25 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.190851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 249/509] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:38.190851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b46676-fec0-4fd5-a87a-93053388799d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.196226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c86d2d-9e83-4fd3-a75b-f1dd612f9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.196880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c86d2d-9e83-4fd3-a75b-f1dd612f9a93 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.197163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c86d2d-9e83-4fd3-a75b-f1dd612f9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.197437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c86d2d-9e83-4fd3-a75b-f1dd612f9a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.210266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c86d2d-9e83-4fd3-a75b-f1dd612f9a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.211813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c86d2d-9e83-4fd3-a75b-f1dd612f9a93 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-d8c86d2d-9e83-4fd3-a75b-f1dd612f9a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:38.232261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:38.233210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:38.234058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:38.234058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:38.234058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:38.234058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 261/510] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:38.234573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c86d2d-9e83-4fd3-a75b-f1dd612f9a93 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.248860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.307544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b46676-fec0-4fd5-a87a-93053388799d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.341366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.343478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f8fb2-732f-4ac6-9e94-b7e6d53e533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.344103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f8fb2-732f-4ac6-9e94-b7e6d53e533b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.344386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f8fb2-732f-4ac6-9e94-b7e6d53e533b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.344662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f8fb2-732f-4ac6-9e94-b7e6d53e533b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.348967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c86d2d-9e83-4fd3-a75b-f1dd612f9a93 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.382150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7514e3b-c9d7-486f-9703-9d2cda26fa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.382800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7514e3b-c9d7-486f-9703-9d2cda26fa2e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.383076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7514e3b-c9d7-486f-9703-9d2cda26fa2e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.383598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7514e3b-c9d7-486f-9703-9d2cda26fa2e None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.384317 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7514e3b-c9d7-486f-9703-9d2cda26fa2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:38.384623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7514e3b-c9d7-486f-9703-9d2cda26fa2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.386059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7514e3b-c9d7-486f-9703-9d2cda26fa2e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.404729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 262/511] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:38.405550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7514e3b-c9d7-486f-9703-9d2cda26fa2e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.421791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f8fb2-732f-4ac6-9e94-b7e6d53e533b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.423316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f8fb2-732f-4ac6-9e94-b7e6d53e533b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.469580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.504632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7514e3b-c9d7-486f-9703-9d2cda26fa2e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.532886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 250/512] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:38.532886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f8fb2-732f-4ac6-9e94-b7e6d53e533b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.539558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e8a70-8373-402f-87fb-d33504e48902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.540295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e8a70-8373-402f-87fb-d33504e48902 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.540573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e8a70-8373-402f-87fb-d33504e48902 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.540844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e8a70-8373-402f-87fb-d33504e48902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.565332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.612990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e8a70-8373-402f-87fb-d33504e48902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.615158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e8a70-8373-402f-87fb-d33504e48902 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.643829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f8fb2-732f-4ac6-9e94-b7e6d53e533b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.678251 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fb32e-4e85-408e-80cc-f017dd6029e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.678884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fb32e-4e85-408e-80cc-f017dd6029e2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.679170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fb32e-4e85-408e-80cc-f017dd6029e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.679441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fb32e-4e85-408e-80cc-f017dd6029e2 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.680079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fb32e-4e85-408e-80cc-f017dd6029e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:38.680382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fb32e-4e85-408e-80cc-f017dd6029e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.681780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fb32e-4e85-408e-80cc-f017dd6029e2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.693395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 251/513] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:38.694416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fb32e-4e85-408e-80cc-f017dd6029e2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.704377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.718755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 263/514] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:38.719703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e8a70-8373-402f-87fb-d33504e48902 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.774982 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.805738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fb32e-4e85-408e-80cc-f017dd6029e2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.823432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e8a70-8373-402f-87fb-d33504e48902 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.844147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5959-71b3-4205-9f7d-a67ea730abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.844778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5959-71b3-4205-9f7d-a67ea730abd7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.845059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5959-71b3-4205-9f7d-a67ea730abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.845332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5959-71b3-4205-9f7d-a67ea730abd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.856648 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b5959-71b3-4205-9f7d-a67ea730abd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.858108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b5959-71b3-4205-9f7d-a67ea730abd7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.861220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f8702-2384-4ef6-8575-aa380f724102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.861761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f8702-2384-4ef6-8575-aa380f724102 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.862042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f8702-2384-4ef6-8575-aa380f724102 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.862342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f8702-2384-4ef6-8575-aa380f724102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ae4b5959-71b3-4205-9f7d-a67ea730abd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:38.872100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:38.873229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:38.874226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:38.874226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:38.874226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:38.874226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 252/515] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:38.874226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5959-71b3-4205-9f7d-a67ea730abd7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.934464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.935300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f8702-2384-4ef6-8575-aa380f724102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.936593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f8702-2384-4ef6-8575-aa380f724102 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.977881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5959-71b3-4205-9f7d-a67ea730abd7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.987388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.012649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb903cf-5aac-4b7e-9971-0da77a40a330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.013381 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb903cf-5aac-4b7e-9971-0da77a40a330 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.013661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb903cf-5aac-4b7e-9971-0da77a40a330 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.013937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb903cf-5aac-4b7e-9971-0da77a40a330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.025211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb903cf-5aac-4b7e-9971-0da77a40a330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.026629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb903cf-5aac-4b7e-9971-0da77a40a330 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.038198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 264/516] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:39.039208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f8702-2384-4ef6-8575-aa380f724102 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-6bb903cf-5aac-4b7e-9971-0da77a40a330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:39.041215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:39.042103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:39.043990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:39.043990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.043990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:39.043990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 253/517] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:39.043990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb903cf-5aac-4b7e-9971-0da77a40a330 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.150368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f8702-2384-4ef6-8575-aa380f724102 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.152214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb903cf-5aac-4b7e-9971-0da77a40a330 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.162834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.184420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f417644-bd5f-4d64-967d-d7842af01ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.185049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f417644-bd5f-4d64-967d-d7842af01ba9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.185323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f417644-bd5f-4d64-967d-d7842af01ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.185593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f417644-bd5f-4d64-967d-d7842af01ba9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.186401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcda18-d942-4582-8235-a11f63ac60b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.187054 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcda18-d942-4582-8235-a11f63ac60b9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.187393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcda18-d942-4582-8235-a11f63ac60b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.187669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcda18-d942-4582-8235-a11f63ac60b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.193124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f417644-bd5f-4d64-967d-d7842af01ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.194686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f417644-bd5f-4d64-967d-d7842af01ba9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.198257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcda18-d942-4582-8235-a11f63ac60b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.199758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcda18-d942-4582-8235-a11f63ac60b9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-2f417644-bd5f-4d64-967d-d7842af01ba9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:39.206489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:39.208780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 265/518] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:39.210114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f417644-bd5f-4d64-967d-d7842af01ba9 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f0bcda18-d942-4582-8235-a11f63ac60b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:39.217982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:39.219142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:39.220005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:39.220005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.220005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:39.220005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 254/519] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:39.220348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcda18-d942-4582-8235-a11f63ac60b9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.226621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.313969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f417644-bd5f-4d64-967d-d7842af01ba9 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.323653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcda18-d942-4582-8235-a11f63ac60b9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.347425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d61e70-fcbc-4127-9e67-dd229a722827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.348030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d61e70-fcbc-4127-9e67-dd229a722827 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.348305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d61e70-fcbc-4127-9e67-dd229a722827 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.348571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d61e70-fcbc-4127-9e67-dd229a722827 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.349742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d61e70-fcbc-4127-9e67-dd229a722827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:39.350042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d61e70-fcbc-4127-9e67-dd229a722827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.351449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d61e70-fcbc-4127-9e67-dd229a722827 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.357018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd087-e9bb-46ae-943c-44ea58ac0071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.357647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd087-e9bb-46ae-943c-44ea58ac0071 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.357929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd087-e9bb-46ae-943c-44ea58ac0071 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.358197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd087-e9bb-46ae-943c-44ea58ac0071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.363555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 266/520] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:39.365021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d61e70-fcbc-4127-9e67-dd229a722827 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.370925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd087-e9bb-46ae-943c-44ea58ac0071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.372419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd087-e9bb-46ae-943c-44ea58ac0071 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-16ddd087-e9bb-46ae-943c-44ea58ac0071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:39.388436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:39.389625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:39.395182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:39.395182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.395182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:39.395182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 255/521] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:39.395182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd087-e9bb-46ae-943c-44ea58ac0071 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.409953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.438125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.468230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d61e70-fcbc-4127-9e67-dd229a722827 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.500836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd087-e9bb-46ae-943c-44ea58ac0071 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.509123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3d80d-374a-4003-9b47-f3613eb3752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.510018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d80d-374a-4003-9b47-f3613eb3752a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.510445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d80d-374a-4003-9b47-f3613eb3752a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.510960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d80d-374a-4003-9b47-f3613eb3752a None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.511945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3d80d-374a-4003-9b47-f3613eb3752a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:39.512390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3d80d-374a-4003-9b47-f3613eb3752a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.514543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3d80d-374a-4003-9b47-f3613eb3752a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.528161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 267/522] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:39.529058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3d80d-374a-4003-9b47-f3613eb3752a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.543280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485fe62-52ea-456b-ab46-2540638b54e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.544206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fe62-52ea-456b-ab46-2540638b54e1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.544653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fe62-52ea-456b-ab46-2540638b54e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.545023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fe62-52ea-456b-ab46-2540638b54e1 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.545753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485fe62-52ea-456b-ab46-2540638b54e1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:39.546057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485fe62-52ea-456b-ab46-2540638b54e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.547602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485fe62-52ea-456b-ab46-2540638b54e1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.574892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 256/523] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:39.575632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485fe62-52ea-456b-ab46-2540638b54e1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.640882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3d80d-374a-4003-9b47-f3613eb3752a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.647432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.672302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.677822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6f1e-115a-4e39-8ea5-366a17168be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.678440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6f1e-115a-4e39-8ea5-366a17168be6 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.678722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6f1e-115a-4e39-8ea5-366a17168be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.679029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6f1e-115a-4e39-8ea5-366a17168be6 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.679132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485fe62-52ea-456b-ab46-2540638b54e1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.679677 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad6f1e-115a-4e39-8ea5-366a17168be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:39.679981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad6f1e-115a-4e39-8ea5-366a17168be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.681983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad6f1e-115a-4e39-8ea5-366a17168be6 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.693453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 268/524] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:39.694291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6f1e-115a-4e39-8ea5-366a17168be6 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.713563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956d477-89ed-47b0-9668-b3d3afa8d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.714178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956d477-89ed-47b0-9668-b3d3afa8d598 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.714454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956d477-89ed-47b0-9668-b3d3afa8d598 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.714719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956d477-89ed-47b0-9668-b3d3afa8d598 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.715377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956d477-89ed-47b0-9668-b3d3afa8d598 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.716808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956d477-89ed-47b0-9668-b3d3afa8d598 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.738098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 257/525] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:39 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:39.738961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956d477-89ed-47b0-9668-b3d3afa8d598 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.811288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6f1e-115a-4e39-8ea5-366a17168be6 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.852293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6867ae-31ac-4f3f-b305-ed7ddfc33f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.852820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6867ae-31ac-4f3f-b305-ed7ddfc33f6a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.853160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6867ae-31ac-4f3f-b305-ed7ddfc33f6a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.853403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6867ae-31ac-4f3f-b305-ed7ddfc33f6a None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.854034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6867ae-31ac-4f3f-b305-ed7ddfc33f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:39.854319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6867ae-31ac-4f3f-b305-ed7ddfc33f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.855777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6867ae-31ac-4f3f-b305-ed7ddfc33f6a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.875827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 269/526] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:39.875827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6867ae-31ac-4f3f-b305-ed7ddfc33f6a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.892352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956d477-89ed-47b0-9668-b3d3afa8d598 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.928085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.942969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed625d2-59c5-463c-864c-494f3e57e559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.943961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed625d2-59c5-463c-864c-494f3e57e559 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.944334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed625d2-59c5-463c-864c-494f3e57e559 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.944713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed625d2-59c5-463c-864c-494f3e57e559 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.950616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.955023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed625d2-59c5-463c-864c-494f3e57e559 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.956512 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed625d2-59c5-463c-864c-494f3e57e559 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5ed625d2-59c5-463c-864c-494f3e57e559 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:39.969926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:39.974848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 258/527] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:39.975796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed625d2-59c5-463c-864c-494f3e57e559 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.012619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6867ae-31ac-4f3f-b305-ed7ddfc33f6a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.049377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81ecf1-249b-4873-a586-35bc7926ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.049994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81ecf1-249b-4873-a586-35bc7926ca99 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.050268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81ecf1-249b-4873-a586-35bc7926ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.050543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81ecf1-249b-4873-a586-35bc7926ca99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.087198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed625d2-59c5-463c-864c-494f3e57e559 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.123309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81ecf1-249b-4873-a586-35bc7926ca99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.123505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac09c1a-d306-4f62-9d74-b20c1796255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.124129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac09c1a-d306-4f62-9d74-b20c1796255a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.124479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac09c1a-d306-4f62-9d74-b20c1796255a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.124829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac09c1a-d306-4f62-9d74-b20c1796255a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.124937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81ecf1-249b-4873-a586-35bc7926ca99 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.132676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac09c1a-d306-4f62-9d74-b20c1796255a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.134490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac09c1a-d306-4f62-9d74-b20c1796255a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-3ac09c1a-d306-4f62-9d74-b20c1796255a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:40.146626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:40.147684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:40.148555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:40.148555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:40.148555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:40.148555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:40.148555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:40.148555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:40.148555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:40.148555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:40.148555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 259/528] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:40.149045 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac09c1a-d306-4f62-9d74-b20c1796255a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.188043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.218660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.245276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 270/529] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:40.245276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81ecf1-249b-4873-a586-35bc7926ca99 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.281719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac09c1a-d306-4f62-9d74-b20c1796255a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.316364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a4149-1b08-4bda-a17e-126654d11129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.317100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a4149-1b08-4bda-a17e-126654d11129 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.318007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a4149-1b08-4bda-a17e-126654d11129 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.318443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a4149-1b08-4bda-a17e-126654d11129 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.325390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a4149-1b08-4bda-a17e-126654d11129 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.326873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a4149-1b08-4bda-a17e-126654d11129 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-fb5a4149-1b08-4bda-a17e-126654d11129 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:40.338249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:40.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:40.340183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:40.340183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:40.340183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:40.340183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:40.340183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:40.340183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:40.340183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:40.340183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:40.340183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 260/530] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:40.340647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a4149-1b08-4bda-a17e-126654d11129 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.354592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81ecf1-249b-4873-a586-35bc7926ca99 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.391858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0efba2-f527-4ff6-b9a2-fb655e6dfedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.392462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0efba2-f527-4ff6-b9a2-fb655e6dfedb None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.392808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0efba2-f527-4ff6-b9a2-fb655e6dfedb None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.393154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0efba2-f527-4ff6-b9a2-fb655e6dfedb None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.393913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0efba2-f527-4ff6-b9a2-fb655e6dfedb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.394285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0efba2-f527-4ff6-b9a2-fb655e6dfedb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.395842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0efba2-f527-4ff6-b9a2-fb655e6dfedb None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.418433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 271/531] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.418433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0efba2-f527-4ff6-b9a2-fb655e6dfedb None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.434092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.461746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a4149-1b08-4bda-a17e-126654d11129 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.471483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.498259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78390c1e-80c9-4077-8a7c-1415a23bc43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.498903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390c1e-80c9-4077-8a7c-1415a23bc43f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.499186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390c1e-80c9-4077-8a7c-1415a23bc43f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.499510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390c1e-80c9-4077-8a7c-1415a23bc43f None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.500206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78390c1e-80c9-4077-8a7c-1415a23bc43f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.500550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78390c1e-80c9-4077-8a7c-1415a23bc43f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.502000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78390c1e-80c9-4077-8a7c-1415a23bc43f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.523148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 261/532] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.528636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78390c1e-80c9-4077-8a7c-1415a23bc43f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.529114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0efba2-f527-4ff6-b9a2-fb655e6dfedb None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.566151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21777917-68db-427d-9745-10da581ff11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.566834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21777917-68db-427d-9745-10da581ff11f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.567115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21777917-68db-427d-9745-10da581ff11f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.567906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21777917-68db-427d-9745-10da581ff11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.578696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21777917-68db-427d-9745-10da581ff11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.580171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21777917-68db-427d-9745-10da581ff11f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-21777917-68db-427d-9745-10da581ff11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:40.599353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:40.600432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:40.601506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:40.601506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:40.601506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:40.605352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 272/533] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:40.606298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21777917-68db-427d-9745-10da581ff11f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.650418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78390c1e-80c9-4077-8a7c-1415a23bc43f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.675578 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.685155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce1a7-dc98-4a0f-b71c-ad3d1fde8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.685769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce1a7-dc98-4a0f-b71c-ad3d1fde8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.686043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce1a7-dc98-4a0f-b71c-ad3d1fde8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.686314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce1a7-dc98-4a0f-b71c-ad3d1fde8ff3 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.687032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ce1a7-dc98-4a0f-b71c-ad3d1fde8ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.687334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ce1a7-dc98-4a0f-b71c-ad3d1fde8ff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.688791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ce1a7-dc98-4a0f-b71c-ad3d1fde8ff3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.705988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 262/534] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.705988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce1a7-dc98-4a0f-b71c-ad3d1fde8ff3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.724987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21777917-68db-427d-9745-10da581ff11f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.736787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.762212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608bf55-ea84-446c-b0f0-061590d5e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.762845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608bf55-ea84-446c-b0f0-061590d5e350 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.763121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608bf55-ea84-446c-b0f0-061590d5e350 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.763385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608bf55-ea84-446c-b0f0-061590d5e350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.764109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608bf55-ea84-446c-b0f0-061590d5e350 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=d6e704b8291b4934a20cdde2ef127493) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.764424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608bf55-ea84-446c-b0f0-061590d5e350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.765881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608bf55-ea84-446c-b0f0-061590d5e350 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.772001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 273/535] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/role_assignments?user.id=d6e704b8291b4934a20cdde2ef127493&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.772795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608bf55-ea84-446c-b0f0-061590d5e350 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.848859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce1a7-dc98-4a0f-b71c-ad3d1fde8ff3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.893310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05eea-261f-4c21-a35d-ffab2026c9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.894003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05eea-261f-4c21-a35d-ffab2026c9e8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.894292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05eea-261f-4c21-a35d-ffab2026c9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.894569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05eea-261f-4c21-a35d-ffab2026c9e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.895347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05eea-261f-4c21-a35d-ffab2026c9e8 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=3da4ea5ad2924cf4baef5614929b7e7a) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.896093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05eea-261f-4c21-a35d-ffab2026c9e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.898414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05eea-261f-4c21-a35d-ffab2026c9e8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.905773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 263/536] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/role_assignments?user.id=3da4ea5ad2924cf4baef5614929b7e7a&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.906739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05eea-261f-4c21-a35d-ffab2026c9e8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.909595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608bf55-ea84-446c-b0f0-061590d5e350 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.940528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.964940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c618d23-e9d1-4c5d-b13c-e57f94f8f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.965567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c618d23-e9d1-4c5d-b13c-e57f94f8f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.965845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c618d23-e9d1-4c5d-b13c-e57f94f8f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.966111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c618d23-e9d1-4c5d-b13c-e57f94f8f1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.966758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c618d23-e9d1-4c5d-b13c-e57f94f8f1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.967080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c618d23-e9d1-4c5d-b13c-e57f94f8f1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.968449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c618d23-e9d1-4c5d-b13c-e57f94f8f1e4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.999280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 274/537] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:41.004622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c618d23-e9d1-4c5d-b13c-e57f94f8f1e4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:41.028559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:41.040354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05eea-261f-4c21-a35d-ffab2026c9e8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.082308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77063822-4346-41ec-b4fd-2ff3aae7c3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.083721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77063822-4346-41ec-b4fd-2ff3aae7c3cc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.084797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77063822-4346-41ec-b4fd-2ff3aae7c3cc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.085081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77063822-4346-41ec-b4fd-2ff3aae7c3cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.085933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77063822-4346-41ec-b4fd-2ff3aae7c3cc None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=0d4e9baa7a6241b1807c67844c7d424c) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:41.086253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77063822-4346-41ec-b4fd-2ff3aae7c3cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.087884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77063822-4346-41ec-b4fd-2ff3aae7c3cc None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.094547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 264/538] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/role_assignments?user.id=0d4e9baa7a6241b1807c67844c7d424c&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:41.169548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c618d23-e9d1-4c5d-b13c-e57f94f8f1e4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.222829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420759c-3185-4574-8a22-210c990857a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.223477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420759c-3185-4574-8a22-210c990857a4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.224115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420759c-3185-4574-8a22-210c990857a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.224968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420759c-3185-4574-8a22-210c990857a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.232389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420759c-3185-4574-8a22-210c990857a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.233905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420759c-3185-4574-8a22-210c990857a4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-7420759c-3185-4574-8a22-210c990857a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:41.247881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:41.249746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:41.251561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:41.251561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:41.251561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:41.251561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:41.251561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:41.251561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:41.251561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:41.251561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:41.251561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 275/539] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:41.255513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77063822-4346-41ec-b4fd-2ff3aae7c3cc None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:41.387287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77063822-4346-41ec-b4fd-2ff3aae7c3cc None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.425629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757b7b-34f7-4a4b-857c-15bf208cd4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.426316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757b7b-34f7-4a4b-857c-15bf208cd4b5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.426603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757b7b-34f7-4a4b-857c-15bf208cd4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.426965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757b7b-34f7-4a4b-857c-15bf208cd4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.428405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757b7b-34f7-4a4b-857c-15bf208cd4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:41.428714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757b7b-34f7-4a4b-857c-15bf208cd4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.430168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757b7b-34f7-4a4b-857c-15bf208cd4b5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.444757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 265/540] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:41.451914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420759c-3185-4574-8a22-210c990857a4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:41.507994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:41.578904 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420759c-3185-4574-8a22-210c990857a4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.630855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f68e6e-3ac0-48ca-9c71-69c4c28a9cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.631477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68e6e-3ac0-48ca-9c71-69c4c28a9cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.631749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68e6e-3ac0-48ca-9c71-69c4c28a9cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.632012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68e6e-3ac0-48ca-9c71-69c4c28a9cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.632744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f68e6e-3ac0-48ca-9c71-69c4c28a9cb9 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=c13c571a4bd24335b8b149825bd79d71) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:41.633046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f68e6e-3ac0-48ca-9c71-69c4c28a9cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.634736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f68e6e-3ac0-48ca-9c71-69c4c28a9cb9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.640767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 276/541] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:41 2022] GET /identity/v3/role_assignments?user.id=c13c571a4bd24335b8b149825bd79d71&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:42.163086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837c191-5fa8-4fa3-a2e6-f68f5a074986 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.163884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837c191-5fa8-4fa3-a2e6-f68f5a074986 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.163884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837c191-5fa8-4fa3-a2e6-f68f5a074986 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.165170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 266/542] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:42.170639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba1488-88cf-4377-9af7-80e156526b76 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.171184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba1488-88cf-4377-9af7-80e156526b76 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.171352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba1488-88cf-4377-9af7-80e156526b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.199855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d4ba1488-88cf-4377-9af7-80e156526b76 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:42.201199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d4ba1488-88cf-4377-9af7-80e156526b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:42.301108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 277/543] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:42.733198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837c191-5fa8-4fa3-a2e6-f68f5a074986 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:42.758831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:42.867674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837c191-5fa8-4fa3-a2e6-f68f5a074986 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:42.920885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b9aca-9ff4-45a7-9980-b7eaa901924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:42.921537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b9aca-9ff4-45a7-9980-b7eaa901924f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.921818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b9aca-9ff4-45a7-9980-b7eaa901924f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.922093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b9aca-9ff4-45a7-9980-b7eaa901924f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.936879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b9aca-9ff4-45a7-9980-b7eaa901924f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-863b9aca-9ff4-45a7-9980-b7eaa901924f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:42.941626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:42.943885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:42.945822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 267/544] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:42.950802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba1488-88cf-4377-9af7-80e156526b76 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.015569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b04885-bcb5-484c-a826-5f059f00b220 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.015891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b04885-bcb5-484c-a826-5f059f00b220 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.016106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b04885-bcb5-484c-a826-5f059f00b220 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.017456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 268/545] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:43.018784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.032684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bdd9-00d6-4309-89d1-36717adbca18 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.032684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bdd9-00d6-4309-89d1-36717adbca18 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.032684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bdd9-00d6-4309-89d1-36717adbca18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.059438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-14d4bdd9-00d6-4309-89d1-36717adbca18 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:43.060648 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-14d4bdd9-00d6-4309-89d1-36717adbca18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:43.085612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba1488-88cf-4377-9af7-80e156526b76 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.133005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92a7e1-aea9-47ba-abdf-c43a429ea4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.133005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92a7e1-aea9-47ba-abdf-c43a429ea4d8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.133005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92a7e1-aea9-47ba-abdf-c43a429ea4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.133005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92a7e1-aea9-47ba-abdf-c43a429ea4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.133652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92a7e1-aea9-47ba-abdf-c43a429ea4d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:43.133652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92a7e1-aea9-47ba-abdf-c43a429ea4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.136629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92a7e1-aea9-47ba-abdf-c43a429ea4d8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.150474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 278/546] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:43.156729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92a7e1-aea9-47ba-abdf-c43a429ea4d8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.188107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 269/547] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:43.283213 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92a7e1-aea9-47ba-abdf-c43a429ea4d8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.286326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.321301 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b16d2-7892-4620-a216-6ae3d0b03903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.322388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b16d2-7892-4620-a216-6ae3d0b03903 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.322923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b16d2-7892-4620-a216-6ae3d0b03903 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.323439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b16d2-7892-4620-a216-6ae3d0b03903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.336016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b16d2-7892-4620-a216-6ae3d0b03903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.337840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b16d2-7892-4620-a216-6ae3d0b03903 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-362b16d2-7892-4620-a216-6ae3d0b03903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:43.353769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:43.354750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:43.355662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:43.355662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:43.355662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:43.362348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 279/548] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:43.364037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4bdd9-00d6-4309-89d1-36717adbca18 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.373800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.388816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc94f90-e39d-4e94-b5f7-7888fa1dee91 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.389097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc94f90-e39d-4e94-b5f7-7888fa1dee91 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.389293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc94f90-e39d-4e94-b5f7-7888fa1dee91 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.390917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 280/549] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:43.395846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0fac-f00a-44cb-b8f0-898644d4bdf5 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.396646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0fac-f00a-44cb-b8f0-898644d4bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.396962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0fac-f00a-44cb-b8f0-898644d4bdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.439848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-159e0fac-f00a-44cb-b8f0-898644d4bdf5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:43.441075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-159e0fac-f00a-44cb-b8f0-898644d4bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:43.521630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4bdd9-00d6-4309-89d1-36717adbca18 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.550157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 281/550] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:43.551041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e0fac-f00a-44cb-b8f0-898644d4bdf5 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.599760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e442ad9-444a-463c-8ec5-2899b6a2f37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.600393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442ad9-444a-463c-8ec5-2899b6a2f37d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.600677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442ad9-444a-463c-8ec5-2899b6a2f37d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.600943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442ad9-444a-463c-8ec5-2899b6a2f37d None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.601660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e442ad9-444a-463c-8ec5-2899b6a2f37d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:43.601962 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e442ad9-444a-463c-8ec5-2899b6a2f37d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.603443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e442ad9-444a-463c-8ec5-2899b6a2f37d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.632638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 270/551] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:43.638408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e442ad9-444a-463c-8ec5-2899b6a2f37d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.706226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.723623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.726667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e0fac-f00a-44cb-b8f0-898644d4bdf5 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.764936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e442ad9-444a-463c-8ec5-2899b6a2f37d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.773140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5d883-2677-47ed-8107-1aa014bb5ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.773792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5d883-2677-47ed-8107-1aa014bb5ccb None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.774072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5d883-2677-47ed-8107-1aa014bb5ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.774346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5d883-2677-47ed-8107-1aa014bb5ccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.789485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5d883-2677-47ed-8107-1aa014bb5ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-a9f5d883-2677-47ed-8107-1aa014bb5ccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:43.795884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:43.797387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:43.798287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 282/552] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:43.799915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382173c-17c0-40a9-89eb-a1a5c8ef98a2 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.799915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382173c-17c0-40a9-89eb-a1a5c8ef98a2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.800353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382173c-17c0-40a9-89eb-a1a5c8ef98a2 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.803421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 283/553] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:43.807210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382173c-17c0-40a9-89eb-a1a5c8ef98a2 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.813859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8b3eb-ab06-4f89-beef-3bf686251ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.814809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8b3eb-ab06-4f89-beef-3bf686251ed3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.815318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8b3eb-ab06-4f89-beef-3bf686251ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.816196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8b3eb-ab06-4f89-beef-3bf686251ed3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.827378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8b3eb-ab06-4f89-beef-3bf686251ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.829468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8b3eb-ab06-4f89-beef-3bf686251ed3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-63e8b3eb-ab06-4f89-beef-3bf686251ed3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:43.841817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:43.842804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:43.843914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:43.847685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 271/554] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:43.849780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ad07f-bceb-4052-b754-a7765d96cbef None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.850219 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ad07f-bceb-4052-b754-a7765d96cbef None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.850498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ad07f-bceb-4052-b754-a7765d96cbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.869124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-896ad07f-bceb-4052-b754-a7765d96cbef None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:43.870336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-896ad07f-bceb-4052-b754-a7765d96cbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:43.923420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382173c-17c0-40a9-89eb-a1a5c8ef98a2 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.956848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 272/555] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:43.958470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ad07f-bceb-4052-b754-a7765d96cbef None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.965821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d71856-71f1-47bc-8853-7ccfa9de0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.966860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d71856-71f1-47bc-8853-7ccfa9de0165 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.967342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d71856-71f1-47bc-8853-7ccfa9de0165 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.967851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d71856-71f1-47bc-8853-7ccfa9de0165 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.968743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d71856-71f1-47bc-8853-7ccfa9de0165 None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:43.969269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d71856-71f1-47bc-8853-7ccfa9de0165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.971094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d71856-71f1-47bc-8853-7ccfa9de0165 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.982101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 284/556] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:43.983367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d71856-71f1-47bc-8853-7ccfa9de0165 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.996653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.029098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.084511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ad07f-bceb-4052-b754-a7765d96cbef None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.096883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d71856-71f1-47bc-8853-7ccfa9de0165 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.124388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c657c-3fa6-458f-8b46-001b47302047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.125254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c657c-3fa6-458f-8b46-001b47302047 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.125629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c657c-3fa6-458f-8b46-001b47302047 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.126000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c657c-3fa6-458f-8b46-001b47302047 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.132377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532692-edc9-4434-bc44-c81fa6f06599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.132983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532692-edc9-4434-bc44-c81fa6f06599 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.133262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532692-edc9-4434-bc44-c81fa6f06599 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.133781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532692-edc9-4434-bc44-c81fa6f06599 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.134505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce532692-edc9-4434-bc44-c81fa6f06599 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:44.134840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce532692-edc9-4434-bc44-c81fa6f06599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.136274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce532692-edc9-4434-bc44-c81fa6f06599 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.139034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c657c-3fa6-458f-8b46-001b47302047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-209c657c-3fa6-458f-8b46-001b47302047 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:44.143938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:44.145092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:44.147295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 273/557] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:44.147999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c657c-3fa6-458f-8b46-001b47302047 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.161608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 285/558] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:44.163389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6c984-71a6-4cde-ae53-932e85b73165 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.163779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6c984-71a6-4cde-ae53-932e85b73165 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.164131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6c984-71a6-4cde-ae53-932e85b73165 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.169005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 286/559] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:44.169005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6c984-71a6-4cde-ae53-932e85b73165 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.240214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.262706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c657c-3fa6-458f-8b46-001b47302047 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.276569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6c984-71a6-4cde-ae53-932e85b73165 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.279343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.297607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6b9f0-d886-4bba-9ac3-d7084d78a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.298232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6b9f0-d886-4bba-9ac3-d7084d78a520 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.298505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6b9f0-d886-4bba-9ac3-d7084d78a520 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.298787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6b9f0-d886-4bba-9ac3-d7084d78a520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.308999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6b9f0-d886-4bba-9ac3-d7084d78a520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.310482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6b9f0-d886-4bba-9ac3-d7084d78a520 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.311630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a62baa-5795-47cf-b898-5c5e3642085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.312238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a62baa-5795-47cf-b898-5c5e3642085f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.312515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a62baa-5795-47cf-b898-5c5e3642085f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.312786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a62baa-5795-47cf-b898-5c5e3642085f None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.313444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a62baa-5795-47cf-b898-5c5e3642085f None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:44.313746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a62baa-5795-47cf-b898-5c5e3642085f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.315116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a62baa-5795-47cf-b898-5c5e3642085f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.324089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 287/560] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:44.324901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a62baa-5795-47cf-b898-5c5e3642085f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-9da6b9f0-d886-4bba-9ac3-d7084d78a520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:44.326262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:44.332236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:44.333932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:44.333932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:44.333932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:44.333932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 274/561] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:44.333932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfbf41-ec32-4e71-8cef-65807fd1cd5c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.333932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfbf41-ec32-4e71-8cef-65807fd1cd5c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.333932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfbf41-ec32-4e71-8cef-65807fd1cd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.349195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4ddfbf41-ec32-4e71-8cef-65807fd1cd5c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:44.350408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4ddfbf41-ec32-4e71-8cef-65807fd1cd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:44.421670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 275/562] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:44.422519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfbf41-ec32-4e71-8cef-65807fd1cd5c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.434946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a62baa-5795-47cf-b898-5c5e3642085f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.474156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.483269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a2a11-d388-4550-8fdc-63c3e77e1987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.484007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a2a11-d388-4550-8fdc-63c3e77e1987 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.484358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a2a11-d388-4550-8fdc-63c3e77e1987 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.484627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a2a11-d388-4550-8fdc-63c3e77e1987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.539702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.543850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfbf41-ec32-4e71-8cef-65807fd1cd5c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.562615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a2a11-d388-4550-8fdc-63c3e77e1987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.564276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a2a11-d388-4550-8fdc-63c3e77e1987 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.580523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d7a38-65bd-4c72-98b1-0aa96aba2b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.581160 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d7a38-65bd-4c72-98b1-0aa96aba2b6d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.581434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d7a38-65bd-4c72-98b1-0aa96aba2b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.581701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d7a38-65bd-4c72-98b1-0aa96aba2b6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.594599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d7a38-65bd-4c72-98b1-0aa96aba2b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ae4d7a38-65bd-4c72-98b1-0aa96aba2b6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:44.600502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:44.601864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 276/563] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:44.603062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d7a38-65bd-4c72-98b1-0aa96aba2b6d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.688518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 288/564] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:44.689687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a2a11-d388-4550-8fdc-63c3e77e1987 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.718349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d7a38-65bd-4c72-98b1-0aa96aba2b6d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.720042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.754191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815e316-db34-46d5-bcbb-e880d5f6ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.755516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815e316-db34-46d5-bcbb-e880d5f6ad4d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.755905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815e316-db34-46d5-bcbb-e880d5f6ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.756188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815e316-db34-46d5-bcbb-e880d5f6ad4d None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.756958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815e316-db34-46d5-bcbb-e880d5f6ad4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:44.757261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815e316-db34-46d5-bcbb-e880d5f6ad4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.758950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815e316-db34-46d5-bcbb-e880d5f6ad4d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.771528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 277/565] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:44.772296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815e316-db34-46d5-bcbb-e880d5f6ad4d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.793198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.798188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a2a11-d388-4550-8fdc-63c3e77e1987 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.834747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99d34-6b58-4f8b-aead-c347b863f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.835485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99d34-6b58-4f8b-aead-c347b863f615 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.835761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99d34-6b58-4f8b-aead-c347b863f615 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.836030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99d34-6b58-4f8b-aead-c347b863f615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.846941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b99d34-6b58-4f8b-aead-c347b863f615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.848436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b99d34-6b58-4f8b-aead-c347b863f615 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-16b99d34-6b58-4f8b-aead-c347b863f615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:44.865016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:44.866276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:44.868650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:44.868650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:44.868650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:44.868650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 289/566] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:44.868650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99d34-6b58-4f8b-aead-c347b863f615 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.877569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815e316-db34-46d5-bcbb-e880d5f6ad4d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.914618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbedf2-3d0b-4896-9551-e0e3365b092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.915267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbedf2-3d0b-4896-9551-e0e3365b092a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.915554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbedf2-3d0b-4896-9551-e0e3365b092a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.915833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbedf2-3d0b-4896-9551-e0e3365b092a None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.916505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbedf2-3d0b-4896-9551-e0e3365b092a None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:44.916811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbedf2-3d0b-4896-9551-e0e3365b092a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.918230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbedf2-3d0b-4896-9551-e0e3365b092a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.931399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 278/567] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:44.931399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbedf2-3d0b-4896-9551-e0e3365b092a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.957142 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.976517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99d34-6b58-4f8b-aead-c347b863f615 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.009659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f664b0b-7851-4e6b-8825-a9484e344d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.010281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f664b0b-7851-4e6b-8825-a9484e344d19 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.010555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f664b0b-7851-4e6b-8825-a9484e344d19 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.010930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f664b0b-7851-4e6b-8825-a9484e344d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.011074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.021370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f664b0b-7851-4e6b-8825-a9484e344d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.022842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f664b0b-7851-4e6b-8825-a9484e344d19 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.030950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbedf2-3d0b-4896-9551-e0e3365b092a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-2f664b0b-7851-4e6b-8825-a9484e344d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:45.037341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:45.038626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:45.040026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:45.040026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:45.040026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:45.040026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 290/568] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:45.040026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f664b0b-7851-4e6b-8825-a9484e344d19 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.071740 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737a56-2a91-4551-8dbc-d14300ed22ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.072284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737a56-2a91-4551-8dbc-d14300ed22ef None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.072560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737a56-2a91-4551-8dbc-d14300ed22ef None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.072827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737a56-2a91-4551-8dbc-d14300ed22ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.084044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80737a56-2a91-4551-8dbc-d14300ed22ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-80737a56-2a91-4551-8dbc-d14300ed22ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:45.089135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:45.090301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 279/569] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:45.091376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737a56-2a91-4551-8dbc-d14300ed22ef None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.146636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f664b0b-7851-4e6b-8825-a9484e344d19 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.175756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.181380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44608f31-ea27-45bf-8b27-92de8e98b77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.182010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44608f31-ea27-45bf-8b27-92de8e98b77c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.182287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44608f31-ea27-45bf-8b27-92de8e98b77c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.182561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44608f31-ea27-45bf-8b27-92de8e98b77c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.189958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44608f31-ea27-45bf-8b27-92de8e98b77c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.191421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44608f31-ea27-45bf-8b27-92de8e98b77c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.194217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737a56-2a91-4551-8dbc-d14300ed22ef None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-44608f31-ea27-45bf-8b27-92de8e98b77c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:45.203136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:45.204318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:45.205499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:45.206939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 291/570] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:45.208587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44608f31-ea27-45bf-8b27-92de8e98b77c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.229687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c0d47-9830-4e14-9b11-a020afa64488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.230301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c0d47-9830-4e14-9b11-a020afa64488 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.230582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c0d47-9830-4e14-9b11-a020afa64488 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.230882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c0d47-9830-4e14-9b11-a020afa64488 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.231525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c0d47-9830-4e14-9b11-a020afa64488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:45.231831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c0d47-9830-4e14-9b11-a020afa64488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.233210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c0d47-9830-4e14-9b11-a020afa64488 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.242353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.245744 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 280/571] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:45.247099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c0d47-9830-4e14-9b11-a020afa64488 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.313164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44608f31-ea27-45bf-8b27-92de8e98b77c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.347600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2277-f25c-4071-85f1-7960cc2fa1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.348177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2277-f25c-4071-85f1-7960cc2fa1bd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.348484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2277-f25c-4071-85f1-7960cc2fa1bd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.348760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2277-f25c-4071-85f1-7960cc2fa1bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.352094 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c0d47-9830-4e14-9b11-a020afa64488 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.359203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2277-f25c-4071-85f1-7960cc2fa1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.360656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2277-f25c-4071-85f1-7960cc2fa1bd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-54bd2277-f25c-4071-85f1-7960cc2fa1bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:45.375373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:45.376619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:45.377513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:45.377513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:45.377513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:45.377513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 292/572] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:45.377779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2277-f25c-4071-85f1-7960cc2fa1bd None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.393085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c7fc2-1455-483a-ac26-fe8ae517c539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.393701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7fc2-1455-483a-ac26-fe8ae517c539 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.393985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7fc2-1455-483a-ac26-fe8ae517c539 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.394257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7fc2-1455-483a-ac26-fe8ae517c539 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.394950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c7fc2-1455-483a-ac26-fe8ae517c539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:45.395286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c7fc2-1455-483a-ac26-fe8ae517c539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.397248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c7fc2-1455-483a-ac26-fe8ae517c539 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.408550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 281/573] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:45.409398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c7fc2-1455-483a-ac26-fe8ae517c539 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.424197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.469881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.479219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2277-f25c-4071-85f1-7960cc2fa1bd None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.511842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c7fc2-1455-483a-ac26-fe8ae517c539 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.513537 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c5fe5-ebb9-4042-8dec-0ef07c67e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.514149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c5fe5-ebb9-4042-8dec-0ef07c67e0d2 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.514427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c5fe5-ebb9-4042-8dec-0ef07c67e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.514695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c5fe5-ebb9-4042-8dec-0ef07c67e0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.515378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c5fe5-ebb9-4042-8dec-0ef07c67e0d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:45.515680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c5fe5-ebb9-4042-8dec-0ef07c67e0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.517052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c5fe5-ebb9-4042-8dec-0ef07c67e0d2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.527601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 293/574] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:45.528435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c5fe5-ebb9-4042-8dec-0ef07c67e0d2 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.555096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4472c-fdc7-4ab9-8034-a85216896c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.555723 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4472c-fdc7-4ab9-8034-a85216896c4c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.556005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4472c-fdc7-4ab9-8034-a85216896c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.556280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4472c-fdc7-4ab9-8034-a85216896c4c None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.557024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4472c-fdc7-4ab9-8034-a85216896c4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:45.557333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4472c-fdc7-4ab9-8034-a85216896c4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.558826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4472c-fdc7-4ab9-8034-a85216896c4c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.577464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 282/575] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:45.578376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4472c-fdc7-4ab9-8034-a85216896c4c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.643046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c5fe5-ebb9-4042-8dec-0ef07c67e0d2 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.649867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.677481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c25f1d-3cfe-4b17-98ef-a1f1bbd0e504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.678115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25f1d-3cfe-4b17-98ef-a1f1bbd0e504 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.678393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25f1d-3cfe-4b17-98ef-a1f1bbd0e504 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.678665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25f1d-3cfe-4b17-98ef-a1f1bbd0e504 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.680138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4472c-fdc7-4ab9-8034-a85216896c4c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.686139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c25f1d-3cfe-4b17-98ef-a1f1bbd0e504 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.687627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c25f1d-3cfe-4b17-98ef-a1f1bbd0e504 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.698112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-e9c25f1d-3cfe-4b17-98ef-a1f1bbd0e504 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:45.699243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:45.705271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 294/576] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:45.706464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c25f1d-3cfe-4b17-98ef-a1f1bbd0e504 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.721621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c016146-a39d-491b-86c2-298ca02f73b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.722241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c016146-a39d-491b-86c2-298ca02f73b9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.722542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c016146-a39d-491b-86c2-298ca02f73b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.722926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c016146-a39d-491b-86c2-298ca02f73b9 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.723621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c016146-a39d-491b-86c2-298ca02f73b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:45.724171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c016146-a39d-491b-86c2-298ca02f73b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.725686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c016146-a39d-491b-86c2-298ca02f73b9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.736746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 283/577] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:45.737544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c016146-a39d-491b-86c2-298ca02f73b9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.804470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c25f1d-3cfe-4b17-98ef-a1f1bbd0e504 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.839786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c016146-a39d-491b-86c2-298ca02f73b9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.839987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcca5e3-b417-4f5b-8bbe-d7e88bfb4240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.840817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcca5e3-b417-4f5b-8bbe-d7e88bfb4240 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.841103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcca5e3-b417-4f5b-8bbe-d7e88bfb4240 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.841474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcca5e3-b417-4f5b-8bbe-d7e88bfb4240 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.854347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcca5e3-b417-4f5b-8bbe-d7e88bfb4240 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.857954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcca5e3-b417-4f5b-8bbe-d7e88bfb4240 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-1dcca5e3-b417-4f5b-8bbe-d7e88bfb4240 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:45.872403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:45.873504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 295/578] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:45.874505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcca5e3-b417-4f5b-8bbe-d7e88bfb4240 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.880802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f89d0-f835-4766-b7b9-192e1c65df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.881458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f89d0-f835-4766-b7b9-192e1c65df28 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.881743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f89d0-f835-4766-b7b9-192e1c65df28 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.882016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f89d0-f835-4766-b7b9-192e1c65df28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.895601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f89d0-f835-4766-b7b9-192e1c65df28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.897010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f89d0-f835-4766-b7b9-192e1c65df28 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.907210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e79f89d0-f835-4766-b7b9-192e1c65df28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:45.911363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:45.912471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:45.913617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:45.913617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:45.913617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:45.914095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 284/579] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:45.914967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f89d0-f835-4766-b7b9-192e1c65df28 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.947260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.984194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcca5e3-b417-4f5b-8bbe-d7e88bfb4240 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.019504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f89d0-f835-4766-b7b9-192e1c65df28 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.019735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c70ef-3b4a-4952-8986-c140590054af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.020851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c70ef-3b4a-4952-8986-c140590054af None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.021145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c70ef-3b4a-4952-8986-c140590054af None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.021412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c70ef-3b4a-4952-8986-c140590054af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.031865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c70ef-3b4a-4952-8986-c140590054af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.033295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c70ef-3b4a-4952-8986-c140590054af None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-f01c70ef-3b4a-4952-8986-c140590054af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:46.049208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:46.050450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:46.051784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:46.051784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:46.051784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:46.051784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 296/580] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:46.051784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c70ef-3b4a-4952-8986-c140590054af None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.057593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30145d42-8e44-4587-9b66-557cc1669d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.058209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30145d42-8e44-4587-9b66-557cc1669d48 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.058571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30145d42-8e44-4587-9b66-557cc1669d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.058758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30145d42-8e44-4587-9b66-557cc1669d48 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.059508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30145d42-8e44-4587-9b66-557cc1669d48 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.059811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30145d42-8e44-4587-9b66-557cc1669d48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.061253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30145d42-8e44-4587-9b66-557cc1669d48 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.079296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 285/581] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:46.079938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30145d42-8e44-4587-9b66-557cc1669d48 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.138255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.167586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c70ef-3b4a-4952-8986-c140590054af None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.174705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.187705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30145d42-8e44-4587-9b66-557cc1669d48 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.206652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e991c-afec-48dc-89cb-90ec292b3b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.207322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e991c-afec-48dc-89cb-90ec292b3b8e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.207604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e991c-afec-48dc-89cb-90ec292b3b8e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.208456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e991c-afec-48dc-89cb-90ec292b3b8e None admin] PATH_INFO: `/v3/users/glance` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.216171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e991c-afec-48dc-89cb-90ec292b3b8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.217642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e991c-afec-48dc-89cb-90ec292b3b8e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.224161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce18d29-011c-4be7-b83e-afeb934c1aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.224679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce18d29-011c-4be7-b83e-afeb934c1aae None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.225049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce18d29-011c-4be7-b83e-afeb934c1aae None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.225325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce18d29-011c-4be7-b83e-afeb934c1aae None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.226017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce18d29-011c-4be7-b83e-afeb934c1aae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.226325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce18d29-011c-4be7-b83e-afeb934c1aae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.227810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce18d29-011c-4be7-b83e-afeb934c1aae None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4b1e991c-afec-48dc-89cb-90ec292b3b8e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:46.229593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:46.230718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 297/582] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:46.231953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e991c-afec-48dc-89cb-90ec292b3b8e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.242801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 286/583] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:46.243266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce18d29-011c-4be7-b83e-afeb934c1aae None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.343428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e991c-afec-48dc-89cb-90ec292b3b8e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.344633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce18d29-011c-4be7-b83e-afeb934c1aae None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.377890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469eb2-a538-41ca-beec-95a964039319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.378510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469eb2-a538-41ca-beec-95a964039319 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.378760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469eb2-a538-41ca-beec-95a964039319 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.379065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469eb2-a538-41ca-beec-95a964039319 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.379376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6b38f-fdbb-482d-8cdf-385ac69236c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.379747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e469eb2-a538-41ca-beec-95a964039319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.380046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e469eb2-a538-41ca-beec-95a964039319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.380198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6b38f-fdbb-482d-8cdf-385ac69236c7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.380543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6b38f-fdbb-482d-8cdf-385ac69236c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.380882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6b38f-fdbb-482d-8cdf-385ac69236c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.381425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e469eb2-a538-41ca-beec-95a964039319 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.381659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6b38f-fdbb-482d-8cdf-385ac69236c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.382033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6b38f-fdbb-482d-8cdf-385ac69236c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.383729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6b38f-fdbb-482d-8cdf-385ac69236c7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.391030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.394250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 287/584] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:46.395109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469eb2-a538-41ca-beec-95a964039319 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.402198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 298/585] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:46.403229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6b38f-fdbb-482d-8cdf-385ac69236c7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.407075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.499677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469eb2-a538-41ca-beec-95a964039319 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.503129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6b38f-fdbb-482d-8cdf-385ac69236c7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.537494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79195c2-5d8d-4561-b080-b16171d2774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.538133 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79195c2-5d8d-4561-b080-b16171d2774d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.538414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79195c2-5d8d-4561-b080-b16171d2774d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.538687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79195c2-5d8d-4561-b080-b16171d2774d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.547214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e145e-22e9-43bc-bc96-9812823a8fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.548020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e145e-22e9-43bc-bc96-9812823a8fe2 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.548291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e145e-22e9-43bc-bc96-9812823a8fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.548559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e145e-22e9-43bc-bc96-9812823a8fe2 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.549285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e145e-22e9-43bc-bc96-9812823a8fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.549482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79195c2-5d8d-4561-b080-b16171d2774d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.549592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e145e-22e9-43bc-bc96-9812823a8fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.550994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79195c2-5d8d-4561-b080-b16171d2774d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.551133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e145e-22e9-43bc-bc96-9812823a8fe2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f79195c2-5d8d-4561-b080-b16171d2774d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:46.567024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:46.569087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:46.570026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:46.570026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:46.570026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:46.570026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 288/586] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:46.570026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79195c2-5d8d-4561-b080-b16171d2774d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.570329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 299/587] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:46.571149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e145e-22e9-43bc-bc96-9812823a8fe2 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.632825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.636681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.677624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79195c2-5d8d-4561-b080-b16171d2774d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.678196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e145e-22e9-43bc-bc96-9812823a8fe2 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.713792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee629218-a253-4dba-aa23-a69c4c21af80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.714175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43209b4-da3a-47f9-baa4-2301c2d6b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.714401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee629218-a253-4dba-aa23-a69c4c21af80 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.714678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee629218-a253-4dba-aa23-a69c4c21af80 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.714812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43209b4-da3a-47f9-baa4-2301c2d6b8fe None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.714978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee629218-a253-4dba-aa23-a69c4c21af80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.715125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43209b4-da3a-47f9-baa4-2301c2d6b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.715352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43209b4-da3a-47f9-baa4-2301c2d6b8fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.715701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee629218-a253-4dba-aa23-a69c4c21af80 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=7345509ac3604cf99c0e9ef232afcd09) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.716003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee629218-a253-4dba-aa23-a69c4c21af80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.717628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee629218-a253-4dba-aa23-a69c4c21af80 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.721978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43209b4-da3a-47f9-baa4-2301c2d6b8fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.723280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 289/588] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/role_assignments?user.id=7345509ac3604cf99c0e9ef232afcd09&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:46.723539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43209b4-da3a-47f9-baa4-2301c2d6b8fe None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.724056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee629218-a253-4dba-aa23-a69c4c21af80 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-b43209b4-da3a-47f9-baa4-2301c2d6b8fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:46.735989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:46.737177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:46.738385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:46.738385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:46.738385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:46.738385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:46.738385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:46.738385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:46.738385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:46.738385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:46.745409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 300/589] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:46.745409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43209b4-da3a-47f9-baa4-2301c2d6b8fe None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.847719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee629218-a253-4dba-aa23-a69c4c21af80 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.856148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43209b4-da3a-47f9-baa4-2301c2d6b8fe None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.875361 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.877245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.893338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b97f40-7ecd-4e7b-99f2-e03ad4594774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.894263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b97f40-7ecd-4e7b-99f2-e03ad4594774 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.894635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b97f40-7ecd-4e7b-99f2-e03ad4594774 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.895077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b97f40-7ecd-4e7b-99f2-e03ad4594774 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.905253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b97f40-7ecd-4e7b-99f2-e03ad4594774 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.905550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3271c02-202f-4cd2-934d-21e9f70d95a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.906447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3271c02-202f-4cd2-934d-21e9f70d95a0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.907041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3271c02-202f-4cd2-934d-21e9f70d95a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b97f40-7ecd-4e7b-99f2-e03ad4594774 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.907659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3271c02-202f-4cd2-934d-21e9f70d95a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.908693 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3271c02-202f-4cd2-934d-21e9f70d95a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.908996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3271c02-202f-4cd2-934d-21e9f70d95a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.910362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3271c02-202f-4cd2-934d-21e9f70d95a0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-70b97f40-7ecd-4e7b-99f2-e03ad4594774 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:46.922348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:46.923593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 290/590] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:46.924560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b97f40-7ecd-4e7b-99f2-e03ad4594774 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.931303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 301/591] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:46.932633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3271c02-202f-4cd2-934d-21e9f70d95a0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.047887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b97f40-7ecd-4e7b-99f2-e03ad4594774 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.049007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3271c02-202f-4cd2-934d-21e9f70d95a0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.083882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac6dd6-5be7-4911-91c1-82c860cdd7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.084588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac6dd6-5be7-4911-91c1-82c860cdd7a4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.084871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac6dd6-5be7-4911-91c1-82c860cdd7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.085142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac6dd6-5be7-4911-91c1-82c860cdd7a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.086406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061d3e-fe41-4ebd-abef-908024918051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.087137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061d3e-fe41-4ebd-abef-908024918051 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.087502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061d3e-fe41-4ebd-abef-908024918051 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.087887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061d3e-fe41-4ebd-abef-908024918051 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.088664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061d3e-fe41-4ebd-abef-908024918051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:47.089062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061d3e-fe41-4ebd-abef-908024918051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.090587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061d3e-fe41-4ebd-abef-908024918051 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.096083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac6dd6-5be7-4911-91c1-82c860cdd7a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.097519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac6dd6-5be7-4911-91c1-82c860cdd7a4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.109183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 302/592] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:47.109183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061d3e-fe41-4ebd-abef-908024918051 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-67ac6dd6-5be7-4911-91c1-82c860cdd7a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:47.119271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:47.120465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:47.121567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:47.121567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:47.121567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:47.126743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 291/593] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:47.126743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac6dd6-5be7-4911-91c1-82c860cdd7a4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.156383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:47.161595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:47.230592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061d3e-fe41-4ebd-abef-908024918051 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.231547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac6dd6-5be7-4911-91c1-82c860cdd7a4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.270522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6e8d3-f694-43d8-9307-d6a35f5c8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.272058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e8d3-f694-43d8-9307-d6a35f5c8917 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.272877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e8d3-f694-43d8-9307-d6a35f5c8917 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.273416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f584-6367-4c59-b600-8fae14c73c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.273705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e8d3-f694-43d8-9307-d6a35f5c8917 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.274249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f584-6367-4c59-b600-8fae14c73c94 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.274524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f584-6367-4c59-b600-8fae14c73c94 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.274816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f584-6367-4c59-b600-8fae14c73c94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.275099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e8d3-f694-43d8-9307-d6a35f5c8917 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:47.275836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e8d3-f694-43d8-9307-d6a35f5c8917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.277434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e8d3-f694-43d8-9307-d6a35f5c8917 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.282409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058f584-6367-4c59-b600-8fae14c73c94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.284080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058f584-6367-4c59-b600-8fae14c73c94 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-3058f584-6367-4c59-b600-8fae14c73c94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:47.296545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:47.298282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:47.299934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:47.299934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:47.299934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:47.299934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:47.299934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:47.299934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:47.299934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:47.299934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:47.302898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 292/594] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:47.303758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f584-6367-4c59-b600-8fae14c73c94 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.311518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 303/595] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Aug 18 20:34:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:47.313104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6e8d3-f694-43d8-9307-d6a35f5c8917 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.419388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:47.425592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f584-6367-4c59-b600-8fae14c73c94 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.432753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:47.441582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6e8d3-f694-43d8-9307-d6a35f5c8917 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.461612 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9cbac-0143-45cc-97ac-1d1b48ab6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.462498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9cbac-0143-45cc-97ac-1d1b48ab6820 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.462891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9cbac-0143-45cc-97ac-1d1b48ab6820 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.463235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9cbac-0143-45cc-97ac-1d1b48ab6820 None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/d6e704b8291b4934a20cdde2ef127493/roles/04d187050a844fdf95f14768fd866f8e` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.478214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846bde0-9724-484c-8fbc-262e6a53e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.478850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846bde0-9724-484c-8fbc-262e6a53e660 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.479175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846bde0-9724-484c-8fbc-262e6a53e660 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.479390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846bde0-9724-484c-8fbc-262e6a53e660 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.479900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9cbac-0143-45cc-97ac-1d1b48ab6820 None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=d6e704b8291b4934a20cdde2ef127493, role_id=04d187050a844fdf95f14768fd866f8e)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.480025 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846bde0-9724-484c-8fbc-262e6a53e660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:47.480310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846bde0-9724-484c-8fbc-262e6a53e660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.481365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9cbac-0143-45cc-97ac-1d1b48ab6820 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.481644 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846bde0-9724-484c-8fbc-262e6a53e660 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.498290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 304/596] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:47.498290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846bde0-9724-484c-8fbc-262e6a53e660 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.501114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 293/597] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:47 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/d6e704b8291b4934a20cdde2ef127493/roles/04d187050a844fdf95f14768fd866f8e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:47.501931 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9cbac-0143-45cc-97ac-1d1b48ab6820 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.647527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9cbac-0143-45cc-97ac-1d1b48ab6820 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.651884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846bde0-9724-484c-8fbc-262e6a53e660 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.693016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5f8bf-46d7-44d3-b3a6-a5b0ace0c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.693943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5f8bf-46d7-44d3-b3a6-a5b0ace0c70d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.694227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5f8bf-46d7-44d3-b3a6-a5b0ace0c70d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.694501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5f8bf-46d7-44d3-b3a6-a5b0ace0c70d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.701748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061daf2-214d-4c89-9d8b-2d2082636050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.702627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061daf2-214d-4c89-9d8b-2d2082636050 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.703122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061daf2-214d-4c89-9d8b-2d2082636050 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.703598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061daf2-214d-4c89-9d8b-2d2082636050 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.704784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061daf2-214d-4c89-9d8b-2d2082636050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:47.705425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061daf2-214d-4c89-9d8b-2d2082636050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.707043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061daf2-214d-4c89-9d8b-2d2082636050 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.707354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5f8bf-46d7-44d3-b3a6-a5b0ace0c70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.709254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5f8bf-46d7-44d3-b3a6-a5b0ace0c70d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.720108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:47.722813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 305/598] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:47.723767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061daf2-214d-4c89-9d8b-2d2082636050 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5bb5f8bf-46d7-44d3-b3a6-a5b0ace0c70d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:47.727568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:47.728555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:47.729445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:47.729445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:47.729445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:47.733412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 294/599] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:47.734455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5f8bf-46d7-44d3-b3a6-a5b0ace0c70d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.745369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:47.863156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5f8bf-46d7-44d3-b3a6-a5b0ace0c70d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.868935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061daf2-214d-4c89-9d8b-2d2082636050 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.902720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bd577-eac6-4ce0-8ba3-371e39d4ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.903501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bd577-eac6-4ce0-8ba3-371e39d4ee43 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.904013 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bd577-eac6-4ce0-8ba3-371e39d4ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.904226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bd577-eac6-4ce0-8ba3-371e39d4ee43 None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/3da4ea5ad2924cf4baef5614929b7e7a/roles/04d187050a844fdf95f14768fd866f8e` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.916005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb00e2-93ba-4902-9848-f5988e73da9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.916750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb00e2-93ba-4902-9848-f5988e73da9b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.917100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb00e2-93ba-4902-9848-f5988e73da9b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.917445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb00e2-93ba-4902-9848-f5988e73da9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.923763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bd577-eac6-4ce0-8ba3-371e39d4ee43 None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=3da4ea5ad2924cf4baef5614929b7e7a, role_id=04d187050a844fdf95f14768fd866f8e)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.924708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb00e2-93ba-4902-9848-f5988e73da9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.925738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bd577-eac6-4ce0-8ba3-371e39d4ee43 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.926281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb00e2-93ba-4902-9848-f5988e73da9b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-fcdb00e2-93ba-4902-9848-f5988e73da9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:47.939704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:47.940724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:47.941607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:47.941607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:47.941607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:47.941607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:47.941607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:47.941607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:47.941607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:47.941607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:47.946692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 306/601] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:47.946934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 295/601] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:47 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/3da4ea5ad2924cf4baef5614929b7e7a/roles/04d187050a844fdf95f14768fd866f8e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:47.947834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb00e2-93ba-4902-9848-f5988e73da9b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:47.948372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bd577-eac6-4ce0-8ba3-371e39d4ee43 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.021490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:48.093516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bd577-eac6-4ce0-8ba3-371e39d4ee43 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.136303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f89ae-a611-4eca-b531-bfecd3a5bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.137385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f89ae-a611-4eca-b531-bfecd3a5bf5a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.137872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f89ae-a611-4eca-b531-bfecd3a5bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.138317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f89ae-a611-4eca-b531-bfecd3a5bf5a None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.139492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f89ae-a611-4eca-b531-bfecd3a5bf5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:48.140005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f89ae-a611-4eca-b531-bfecd3a5bf5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.141804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f89ae-a611-4eca-b531-bfecd3a5bf5a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.152328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:48.159107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 296/602] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:48.170801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f89ae-a611-4eca-b531-bfecd3a5bf5a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.190895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb00e2-93ba-4902-9848-f5988e73da9b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.229783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2dc00-05a8-48f2-a6bd-f77ecf1650fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.230356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2dc00-05a8-48f2-a6bd-f77ecf1650fd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.230635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2dc00-05a8-48f2-a6bd-f77ecf1650fd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.230938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2dc00-05a8-48f2-a6bd-f77ecf1650fd None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.231588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2dc00-05a8-48f2-a6bd-f77ecf1650fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:48.231893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2dc00-05a8-48f2-a6bd-f77ecf1650fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.233279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2dc00-05a8-48f2-a6bd-f77ecf1650fd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.249329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 307/603] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:48.258790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2dc00-05a8-48f2-a6bd-f77ecf1650fd None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.317686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f89ae-a611-4eca-b531-bfecd3a5bf5a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.328692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:48.389735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2dc00-05a8-48f2-a6bd-f77ecf1650fd None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.406869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea1255-cd94-42a9-96e7-d1b7d397fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.407560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea1255-cd94-42a9-96e7-d1b7d397fe10 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.407849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea1255-cd94-42a9-96e7-d1b7d397fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.408124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea1255-cd94-42a9-96e7-d1b7d397fe10 None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/0d4e9baa7a6241b1807c67844c7d424c/roles/04d187050a844fdf95f14768fd866f8e` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.444791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9049a1e-bdb0-4184-ad89-079576fa6669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.446150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9049a1e-bdb0-4184-ad89-079576fa6669 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.446624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9049a1e-bdb0-4184-ad89-079576fa6669 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.447134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9049a1e-bdb0-4184-ad89-079576fa6669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.451080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:48.456054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9049a1e-bdb0-4184-ad89-079576fa6669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.457842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9049a1e-bdb0-4184-ad89-079576fa6669 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.459184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea1255-cd94-42a9-96e7-d1b7d397fe10 None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=0d4e9baa7a6241b1807c67844c7d424c, role_id=04d187050a844fdf95f14768fd866f8e)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.460837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea1255-cd94-42a9-96e7-d1b7d397fe10 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-a9049a1e-bdb0-4184-ad89-079576fa6669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:48.472790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:48.473854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:48.474806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:48.474806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:48.474806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:48.474806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:48.474806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:48.474806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:48.474806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:48.474806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:48.477119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 308/604] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:48.484951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9049a1e-bdb0-4184-ad89-079576fa6669 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.490607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 297/605] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:48 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/0d4e9baa7a6241b1807c67844c7d424c/roles/04d187050a844fdf95f14768fd866f8e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:48.603876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9049a1e-bdb0-4184-ad89-079576fa6669 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.644472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5269b-73d9-4a86-9aa2-49df43081068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.645488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5269b-73d9-4a86-9aa2-49df43081068 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.645972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5269b-73d9-4a86-9aa2-49df43081068 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.646415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5269b-73d9-4a86-9aa2-49df43081068 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.647375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5269b-73d9-4a86-9aa2-49df43081068 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:48.647862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5269b-73d9-4a86-9aa2-49df43081068 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.649567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5269b-73d9-4a86-9aa2-49df43081068 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.663961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 309/606] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:48.669995 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea1255-cd94-42a9-96e7-d1b7d397fe10 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.763297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1d09-f265-4606-8ce2-9d130a46cd02 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.764352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1d09-f265-4606-8ce2-9d130a46cd02 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.764833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1d09-f265-4606-8ce2-9d130a46cd02 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.766327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 310/607] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:48.773504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393737-8fb3-417e-8b36-e3b3f8338849 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.773807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393737-8fb3-417e-8b36-e3b3f8338849 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.774517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393737-8fb3-417e-8b36-e3b3f8338849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.799874 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-37393737-8fb3-417e-8b36-e3b3f8338849 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:48.800851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea1255-cd94-42a9-96e7-d1b7d397fe10 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.801174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-37393737-8fb3-417e-8b36-e3b3f8338849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:48.842255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494d2e1-3910-4314-ba13-689edd160343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.843285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494d2e1-3910-4314-ba13-689edd160343 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.844386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494d2e1-3910-4314-ba13-689edd160343 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.844917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494d2e1-3910-4314-ba13-689edd160343 None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/c13c571a4bd24335b8b149825bd79d71/roles/04d187050a844fdf95f14768fd866f8e` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.863115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494d2e1-3910-4314-ba13-689edd160343 None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=c13c571a4bd24335b8b149825bd79d71, role_id=04d187050a844fdf95f14768fd866f8e)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.865555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494d2e1-3910-4314-ba13-689edd160343 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.888467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 298/608] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:48 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/c13c571a4bd24335b8b149825bd79d71/roles/04d187050a844fdf95f14768fd866f8e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:48.953460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:49.043303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 311/609] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:49.339898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494d2e1-3910-4314-ba13-689edd160343 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:49.360653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:49.511841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494d2e1-3910-4314-ba13-689edd160343 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:49.574567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4c945-8dfa-4518-a794-4d7082be4a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:49.575249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4c945-8dfa-4518-a794-4d7082be4a74 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.575543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4c945-8dfa-4518-a794-4d7082be4a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.575891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4c945-8dfa-4518-a794-4d7082be4a74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.599561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4c945-8dfa-4518-a794-4d7082be4a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ccc4c945-8dfa-4518-a794-4d7082be4a74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:49.604382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:49.605309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:49.606158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 299/610] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:49.611629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393737-8fb3-417e-8b36-e3b3f8338849 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:49.766468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393737-8fb3-417e-8b36-e3b3f8338849 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:49.816882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb11c8f-edd1-4797-b293-5d8154118af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:49.817968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb11c8f-edd1-4797-b293-5d8154118af3 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.818445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb11c8f-edd1-4797-b293-5d8154118af3 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.818955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb11c8f-edd1-4797-b293-5d8154118af3 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.819814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb11c8f-edd1-4797-b293-5d8154118af3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:49.820305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb11c8f-edd1-4797-b293-5d8154118af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:49.821898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb11c8f-edd1-4797-b293-5d8154118af3 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:49.835621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 312/611] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:49.840805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4c945-8dfa-4518-a794-4d7082be4a74 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:49.968337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:50.014323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4c945-8dfa-4518-a794-4d7082be4a74 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.068026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223ed9b-c340-4df3-b425-34faa4cdf2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.068672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223ed9b-c340-4df3-b425-34faa4cdf2f8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.068969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223ed9b-c340-4df3-b425-34faa4cdf2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.069218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223ed9b-c340-4df3-b425-34faa4cdf2f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.084265 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223ed9b-c340-4df3-b425-34faa4cdf2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.085753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223ed9b-c340-4df3-b425-34faa4cdf2f8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-4223ed9b-c340-4df3-b425-34faa4cdf2f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:50.106276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:50.107291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:50.108196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:50.108196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:50.108196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:50.108840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 300/612] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:50.113184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb11c8f-edd1-4797-b293-5d8154118af3 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.167374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47703949-072d-4d99-bcc7-d305bb60ac56 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.167733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47703949-072d-4d99-bcc7-d305bb60ac56 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.167936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47703949-072d-4d99-bcc7-d305bb60ac56 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.169331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 301/613] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:50.180673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e04966-3ac8-401f-b678-da7c1c47bc60 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.181012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e04966-3ac8-401f-b678-da7c1c47bc60 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.181240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e04966-3ac8-401f-b678-da7c1c47bc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.194529 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:50.228072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-86e04966-3ac8-401f-b678-da7c1c47bc60 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:50.229228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-86e04966-3ac8-401f-b678-da7c1c47bc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:50.262907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb11c8f-edd1-4797-b293-5d8154118af3 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.310577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc02e3-856f-4794-9c38-1ee64cc47e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.311232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc02e3-856f-4794-9c38-1ee64cc47e29 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.311513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc02e3-856f-4794-9c38-1ee64cc47e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.311786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc02e3-856f-4794-9c38-1ee64cc47e29 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.312448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc02e3-856f-4794-9c38-1ee64cc47e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:50.312752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc02e3-856f-4794-9c38-1ee64cc47e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.314139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc02e3-856f-4794-9c38-1ee64cc47e29 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.349420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 313/614] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:50.354749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc02e3-856f-4794-9c38-1ee64cc47e29 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.361211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 302/615] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:50.494916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc02e3-856f-4794-9c38-1ee64cc47e29 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.502468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:50.541784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a4a92-17ec-4466-8632-c7fcd789ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.542417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a4a92-17ec-4466-8632-c7fcd789ff74 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.542692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a4a92-17ec-4466-8632-c7fcd789ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.542986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a4a92-17ec-4466-8632-c7fcd789ff74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.554413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a4a92-17ec-4466-8632-c7fcd789ff74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.555949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a4a92-17ec-4466-8632-c7fcd789ff74 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-5d9a4a92-17ec-4466-8632-c7fcd789ff74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:50.571864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:50.572872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:50.573851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 314/616] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:50.580916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e04966-3ac8-401f-b678-da7c1c47bc60 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.681960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:50.684563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a4a92-17ec-4466-8632-c7fcd789ff74 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.800011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e04966-3ac8-401f-b678-da7c1c47bc60 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.848474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a4a92-17ec-4466-8632-c7fcd789ff74 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.856852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8a402-b46c-484f-9d9e-9c61c04b949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.858333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8a402-b46c-484f-9d9e-9c61c04b949a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.858863 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8a402-b46c-484f-9d9e-9c61c04b949a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.859336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8a402-b46c-484f-9d9e-9c61c04b949a None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.861856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8a402-b46c-484f-9d9e-9c61c04b949a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:50.862666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8a402-b46c-484f-9d9e-9c61c04b949a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.866137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8a402-b46c-484f-9d9e-9c61c04b949a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.890107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5a25c-e907-4a80-b327-d872b1c0f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.890961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5a25c-e907-4a80-b327-d872b1c0f38b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.891354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5a25c-e907-4a80-b327-d872b1c0f38b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.891719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5a25c-e907-4a80-b327-d872b1c0f38b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.898087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 303/617] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:50.900256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef7dd-9e17-414d-9167-7334cc8620bd None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.900729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef7dd-9e17-414d-9167-7334cc8620bd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.901730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef7dd-9e17-414d-9167-7334cc8620bd None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.907628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 304/618] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:50.907628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef7dd-9e17-414d-9167-7334cc8620bd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.915461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5a25c-e907-4a80-b327-d872b1c0f38b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-81f5a25c-e907-4a80-b327-d872b1c0f38b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:50.921405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:50.922389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:50.923283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:50.931238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 315/619] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:50.933064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc99e-3bcd-46a1-b42e-d549b568d9bf None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.933580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc99e-3bcd-46a1-b42e-d549b568d9bf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.934073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc99e-3bcd-46a1-b42e-d549b568d9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.954261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f83fc99e-3bcd-46a1-b42e-d549b568d9bf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:50.955808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f83fc99e-3bcd-46a1-b42e-d549b568d9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:50.978828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.032893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 316/620] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:51.034160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc99e-3bcd-46a1-b42e-d549b568d9bf None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.045200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef7dd-9e17-414d-9167-7334cc8620bd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.059784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.094287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df830ca5-c941-4a31-bd17-2770341259aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.095626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df830ca5-c941-4a31-bd17-2770341259aa None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.096308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df830ca5-c941-4a31-bd17-2770341259aa None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.096997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df830ca5-c941-4a31-bd17-2770341259aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.113514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df830ca5-c941-4a31-bd17-2770341259aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.116789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df830ca5-c941-4a31-bd17-2770341259aa None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-df830ca5-c941-4a31-bd17-2770341259aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:51.141037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:51.142196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:51.143161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:51.143161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:51.143161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:51.146680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 305/621] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:51.149274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee863-4889-4ba6-a2db-301956f1520a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.149947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee863-4889-4ba6-a2db-301956f1520a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.150631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc99e-3bcd-46a1-b42e-d549b568d9bf None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.150977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee863-4889-4ba6-a2db-301956f1520a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.153330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 306/622] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:51.154994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee863-4889-4ba6-a2db-301956f1520a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.189055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c89c33-99bf-4fd3-b7ea-bd0893eb5d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.189735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c89c33-99bf-4fd3-b7ea-bd0893eb5d2e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.190033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c89c33-99bf-4fd3-b7ea-bd0893eb5d2e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.190353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c89c33-99bf-4fd3-b7ea-bd0893eb5d2e None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.191050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c89c33-99bf-4fd3-b7ea-bd0893eb5d2e None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:51.191352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c89c33-99bf-4fd3-b7ea-bd0893eb5d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.192797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c89c33-99bf-4fd3-b7ea-bd0893eb5d2e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.206602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 317/623] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:51.208875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c968-4a9c-475f-b9b0-2eba342379c1 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.208875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c968-4a9c-475f-b9b0-2eba342379c1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.209209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c968-4a9c-475f-b9b0-2eba342379c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.228497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1178c968-4a9c-475f-b9b0-2eba342379c1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:51.229963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1178c968-4a9c-475f-b9b0-2eba342379c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:51.244212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.301888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 318/624] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:51.310898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c968-4a9c-475f-b9b0-2eba342379c1 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.312517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee863-4889-4ba6-a2db-301956f1520a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.393382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666ed26-ae7d-416e-b412-ea13c8a48555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.394751 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ed26-ae7d-416e-b412-ea13c8a48555 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.395504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ed26-ae7d-416e-b412-ea13c8a48555 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.396187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ed26-ae7d-416e-b412-ea13c8a48555 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.397927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ed26-ae7d-416e-b412-ea13c8a48555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:51.398698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ed26-ae7d-416e-b412-ea13c8a48555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.401218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ed26-ae7d-416e-b412-ea13c8a48555 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.417202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 307/625] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:51.418842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666ed26-ae7d-416e-b412-ea13c8a48555 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.436995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c968-4a9c-475f-b9b0-2eba342379c1 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.445393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.482516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e73ec-acd7-4280-a932-2c0ec8ce9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.483198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e73ec-acd7-4280-a932-2c0ec8ce9dfe None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.483477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e73ec-acd7-4280-a932-2c0ec8ce9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.483743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e73ec-acd7-4280-a932-2c0ec8ce9dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.495107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e73ec-acd7-4280-a932-2c0ec8ce9dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.496613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e73ec-acd7-4280-a932-2c0ec8ce9dfe None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.506315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-027e73ec-acd7-4280-a932-2c0ec8ce9dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:51.513504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:51.514590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:51.515581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:51.515581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:51.515581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:51.518904 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 319/626] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:51.520140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e73ec-acd7-4280-a932-2c0ec8ce9dfe None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.537343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666ed26-ae7d-416e-b412-ea13c8a48555 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.581243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5ca92-873a-4ab5-b320-f4402b5aa83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.581864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5ca92-873a-4ab5-b320-f4402b5aa83e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.582071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5ca92-873a-4ab5-b320-f4402b5aa83e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.582346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5ca92-873a-4ab5-b320-f4402b5aa83e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.593785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5ca92-873a-4ab5-b320-f4402b5aa83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f2f5ca92-873a-4ab5-b320-f4402b5aa83e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:51.598595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:51.599590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:51.600446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 308/627] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:51.601185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec142ab6-9715-4ac2-b93e-babb73d06111 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.601413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec142ab6-9715-4ac2-b93e-babb73d06111 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.601641 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec142ab6-9715-4ac2-b93e-babb73d06111 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.602968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 309/628] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:51.603485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec142ab6-9715-4ac2-b93e-babb73d06111 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.630015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e73ec-acd7-4280-a932-2c0ec8ce9dfe None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.663885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b1bb5-5ef9-420d-acda-7e575479f852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.664648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1bb5-5ef9-420d-acda-7e575479f852 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.664990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1bb5-5ef9-420d-acda-7e575479f852 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.665283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1bb5-5ef9-420d-acda-7e575479f852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.671901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b1bb5-5ef9-420d-acda-7e575479f852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.673333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b1bb5-5ef9-420d-acda-7e575479f852 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-157b1bb5-5ef9-420d-acda-7e575479f852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:51.684969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:51.686373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 320/629] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:51.687346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b1bb5-5ef9-420d-acda-7e575479f852 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.695268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.716049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec142ab6-9715-4ac2-b93e-babb73d06111 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.747722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.750840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76cd94-a37c-4b24-964e-352c1be3cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.751449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76cd94-a37c-4b24-964e-352c1be3cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.751728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76cd94-a37c-4b24-964e-352c1be3cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.751993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76cd94-a37c-4b24-964e-352c1be3cfa4 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.752629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76cd94-a37c-4b24-964e-352c1be3cfa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:51.752925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76cd94-a37c-4b24-964e-352c1be3cfa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.754395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76cd94-a37c-4b24-964e-352c1be3cfa4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.766853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 310/630] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:51.767694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76cd94-a37c-4b24-964e-352c1be3cfa4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.807859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b1bb5-5ef9-420d-acda-7e575479f852 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.841817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb3ca7-43ba-4167-932d-43b30a37e22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.842364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb3ca7-43ba-4167-932d-43b30a37e22c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.842641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb3ca7-43ba-4167-932d-43b30a37e22c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.842946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb3ca7-43ba-4167-932d-43b30a37e22c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.853511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb3ca7-43ba-4167-932d-43b30a37e22c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-79bb3ca7-43ba-4167-932d-43b30a37e22c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:51.859440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:51.860433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:51.861319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 321/631] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:51.862029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77896ea-c399-4432-b504-369a9a8cf354 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.862029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77896ea-c399-4432-b504-369a9a8cf354 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.862167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77896ea-c399-4432-b504-369a9a8cf354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.879008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76cd94-a37c-4b24-964e-352c1be3cfa4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.880631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c77896ea-c399-4432-b504-369a9a8cf354 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:51.881619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c77896ea-c399-4432-b504-369a9a8cf354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:51.914055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faae57-f7b0-4574-8d24-dd81ab40cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.914671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faae57-f7b0-4574-8d24-dd81ab40cf51 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.914984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faae57-f7b0-4574-8d24-dd81ab40cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.915256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faae57-f7b0-4574-8d24-dd81ab40cf51 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.915919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faae57-f7b0-4574-8d24-dd81ab40cf51 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:51.916220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faae57-f7b0-4574-8d24-dd81ab40cf51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.917605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faae57-f7b0-4574-8d24-dd81ab40cf51 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.925585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 311/632] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:51.926984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faae57-f7b0-4574-8d24-dd81ab40cf51 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.929804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.950521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 322/633] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:51.951555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77896ea-c399-4432-b504-369a9a8cf354 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.004292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.044720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faae57-f7b0-4574-8d24-dd81ab40cf51 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.060582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77896ea-c399-4432-b504-369a9a8cf354 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.085669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02300ca2-77ed-42d1-876a-ce3bfaed6ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.086429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02300ca2-77ed-42d1-876a-ce3bfaed6ccf None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.088783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02300ca2-77ed-42d1-876a-ce3bfaed6ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.088783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02300ca2-77ed-42d1-876a-ce3bfaed6ccf None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.088783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02300ca2-77ed-42d1-876a-ce3bfaed6ccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:52.088783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02300ca2-77ed-42d1-876a-ce3bfaed6ccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.089880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02300ca2-77ed-42d1-876a-ce3bfaed6ccf None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.100327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4abae-5955-4475-9768-72f0fe2cd22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.100745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4abae-5955-4475-9768-72f0fe2cd22f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.101257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4abae-5955-4475-9768-72f0fe2cd22f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.101534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4abae-5955-4475-9768-72f0fe2cd22f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.104587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 312/634] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:52.105839 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02300ca2-77ed-42d1-876a-ce3bfaed6ccf None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.115909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4abae-5955-4475-9768-72f0fe2cd22f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.117410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4abae-5955-4475-9768-72f0fe2cd22f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-b5f4abae-5955-4475-9768-72f0fe2cd22f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:52.129732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:52.130717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:52.131709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:52.135956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 323/635] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:52.136817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4abae-5955-4475-9768-72f0fe2cd22f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.181895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.224851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02300ca2-77ed-42d1-876a-ce3bfaed6ccf None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.255101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4abae-5955-4475-9768-72f0fe2cd22f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.259767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71fd36-5934-46da-bab3-a8a80728bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.260380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71fd36-5934-46da-bab3-a8a80728bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.260669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71fd36-5934-46da-bab3-a8a80728bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.260946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71fd36-5934-46da-bab3-a8a80728bfd4 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.261609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71fd36-5934-46da-bab3-a8a80728bfd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:52.261914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71fd36-5934-46da-bab3-a8a80728bfd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.263370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71fd36-5934-46da-bab3-a8a80728bfd4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.265914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.272420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 313/636] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:52.273601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71fd36-5934-46da-bab3-a8a80728bfd4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.291079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba644b5-b3ce-47d7-b392-46a0f84d7fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.291729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba644b5-b3ce-47d7-b392-46a0f84d7fcd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.292003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba644b5-b3ce-47d7-b392-46a0f84d7fcd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.292276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba644b5-b3ce-47d7-b392-46a0f84d7fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.303963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba644b5-b3ce-47d7-b392-46a0f84d7fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.305408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba644b5-b3ce-47d7-b392-46a0f84d7fcd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4ba644b5-b3ce-47d7-b392-46a0f84d7fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:52.320216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:52.321319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:52.322232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:52.322232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:52.322232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:52.322232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 324/637] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:52.322232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba644b5-b3ce-47d7-b392-46a0f84d7fcd None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.381476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71fd36-5934-46da-bab3-a8a80728bfd4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.404919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.416777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af90cf-d58c-4b8a-bbfe-ee51ae9650bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.417518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af90cf-d58c-4b8a-bbfe-ee51ae9650bf None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.417866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af90cf-d58c-4b8a-bbfe-ee51ae9650bf None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.418213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af90cf-d58c-4b8a-bbfe-ee51ae9650bf None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/7345509ac3604cf99c0e9ef232afcd09/roles/04d187050a844fdf95f14768fd866f8e` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.424662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba644b5-b3ce-47d7-b392-46a0f84d7fcd None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.434150 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af90cf-d58c-4b8a-bbfe-ee51ae9650bf None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=7345509ac3604cf99c0e9ef232afcd09, role_id=04d187050a844fdf95f14768fd866f8e)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.435638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af90cf-d58c-4b8a-bbfe-ee51ae9650bf None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.448473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 314/638] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:52 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/7345509ac3604cf99c0e9ef232afcd09/roles/04d187050a844fdf95f14768fd866f8e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:52.449277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af90cf-d58c-4b8a-bbfe-ee51ae9650bf None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.471766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490012f0-fe5e-49e5-a280-bcac92b1afa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.472609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490012f0-fe5e-49e5-a280-bcac92b1afa6 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.472963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490012f0-fe5e-49e5-a280-bcac92b1afa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.473966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490012f0-fe5e-49e5-a280-bcac92b1afa6 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.474988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490012f0-fe5e-49e5-a280-bcac92b1afa6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:52.475372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490012f0-fe5e-49e5-a280-bcac92b1afa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.476949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490012f0-fe5e-49e5-a280-bcac92b1afa6 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.496749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 325/639] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:52.497632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490012f0-fe5e-49e5-a280-bcac92b1afa6 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.526967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.580085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af90cf-d58c-4b8a-bbfe-ee51ae9650bf None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.628548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490012f0-fe5e-49e5-a280-bcac92b1afa6 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.634601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cd35b-3946-4f90-b620-b2c2f8c6bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.635286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd35b-3946-4f90-b620-b2c2f8c6bc64 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.635561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd35b-3946-4f90-b620-b2c2f8c6bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.635825 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd35b-3946-4f90-b620-b2c2f8c6bc64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.647402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cd35b-3946-4f90-b620-b2c2f8c6bc64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-6d8cd35b-3946-4f90-b620-b2c2f8c6bc64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:52.652112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:52.653227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 315/640] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:52.654900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cd35b-3946-4f90-b620-b2c2f8c6bc64 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.672797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9d422-6b25-40c8-b630-568c2f833d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.673435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9d422-6b25-40c8-b630-568c2f833d6e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.673713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9d422-6b25-40c8-b630-568c2f833d6e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.674017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9d422-6b25-40c8-b630-568c2f833d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.685504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9d422-6b25-40c8-b630-568c2f833d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.687036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9d422-6b25-40c8-b630-568c2f833d6e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.690685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-95f9d422-6b25-40c8-b630-568c2f833d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:52.705299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:52.706531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:52.708244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:52.708244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:52.708244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:52.713204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 326/641] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:52.714253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9d422-6b25-40c8-b630-568c2f833d6e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.774164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cd35b-3946-4f90-b620-b2c2f8c6bc64 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.805953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.811566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed657e21-c2ed-4723-b21e-d139c591b4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.812183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed657e21-c2ed-4723-b21e-d139c591b4fb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.812462 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed657e21-c2ed-4723-b21e-d139c591b4fb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.812735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed657e21-c2ed-4723-b21e-d139c591b4fb None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.813380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed657e21-c2ed-4723-b21e-d139c591b4fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:52.813680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed657e21-c2ed-4723-b21e-d139c591b4fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.815091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed657e21-c2ed-4723-b21e-d139c591b4fb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.827732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 316/642] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:52.828549 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed657e21-c2ed-4723-b21e-d139c591b4fb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.852647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9d422-6b25-40c8-b630-568c2f833d6e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.900561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2094a-6714-401e-9f92-bcd9fc46a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.901547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2094a-6714-401e-9f92-bcd9fc46a31f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.902187 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2094a-6714-401e-9f92-bcd9fc46a31f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.902664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2094a-6714-401e-9f92-bcd9fc46a31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.927748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.936527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed657e21-c2ed-4723-b21e-d139c591b4fb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.974337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899bf59-aaac-4928-8027-8366c74a2b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.975327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899bf59-aaac-4928-8027-8366c74a2b22 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.975636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899bf59-aaac-4928-8027-8366c74a2b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.975915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899bf59-aaac-4928-8027-8366c74a2b22 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.976585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899bf59-aaac-4928-8027-8366c74a2b22 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:52.976892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899bf59-aaac-4928-8027-8366c74a2b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.978271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899bf59-aaac-4928-8027-8366c74a2b22 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.985849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2094a-6714-401e-9f92-bcd9fc46a31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.991894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 317/643] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:52.992061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2094a-6714-401e-9f92-bcd9fc46a31f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.992143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899bf59-aaac-4928-8027-8366c74a2b22 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.064399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.097238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899bf59-aaac-4928-8027-8366c74a2b22 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.102647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 327/644] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:53.102647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2094a-6714-401e-9f92-bcd9fc46a31f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.138986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c416e4e-2ffd-4d6f-acf7-0ecf67c1a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.139599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c416e4e-2ffd-4d6f-acf7-0ecf67c1a83a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.139882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c416e4e-2ffd-4d6f-acf7-0ecf67c1a83a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.140154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c416e4e-2ffd-4d6f-acf7-0ecf67c1a83a None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.140805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c416e4e-2ffd-4d6f-acf7-0ecf67c1a83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:53.141107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c416e4e-2ffd-4d6f-acf7-0ecf67c1a83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.142943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c416e4e-2ffd-4d6f-acf7-0ecf67c1a83a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.156891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 318/645] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:53.157515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c416e4e-2ffd-4d6f-acf7-0ecf67c1a83a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.176442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.211190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2094a-6714-401e-9f92-bcd9fc46a31f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.247447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e53c0-25ef-47bf-913f-8ed1a472f2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.248083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e53c0-25ef-47bf-913f-8ed1a472f2b2 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.248392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e53c0-25ef-47bf-913f-8ed1a472f2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.248664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e53c0-25ef-47bf-913f-8ed1a472f2b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.256569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e53c0-25ef-47bf-913f-8ed1a472f2b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.257894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e53c0-25ef-47bf-913f-8ed1a472f2b2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.266144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c416e4e-2ffd-4d6f-acf7-0ecf67c1a83a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-2c9e53c0-25ef-47bf-913f-8ed1a472f2b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:53.269664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:53.272127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 328/646] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:53.273231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e53c0-25ef-47bf-913f-8ed1a472f2b2 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.307517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9794b-e3d0-4ed6-ba38-53639c017455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.308142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9794b-e3d0-4ed6-ba38-53639c017455 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.308475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9794b-e3d0-4ed6-ba38-53639c017455 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.308744 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9794b-e3d0-4ed6-ba38-53639c017455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.309106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.320491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9794b-e3d0-4ed6-ba38-53639c017455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.322531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9794b-e3d0-4ed6-ba38-53639c017455 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e9e9794b-e3d0-4ed6-ba38-53639c017455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:53.339275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:53.340270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:53.341205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:53.341205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:53.341205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:53.341205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 319/647] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:53.342312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9794b-e3d0-4ed6-ba38-53639c017455 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.393627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e53c0-25ef-47bf-913f-8ed1a472f2b2 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.415361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.436246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b39b9-b881-47cc-a6f0-05f2cd939f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.436969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b39b9-b881-47cc-a6f0-05f2cd939f5a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.437315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b39b9-b881-47cc-a6f0-05f2cd939f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.437666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b39b9-b881-47cc-a6f0-05f2cd939f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.449129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b39b9-b881-47cc-a6f0-05f2cd939f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.450708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b39b9-b881-47cc-a6f0-05f2cd939f5a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.454472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9794b-e3d0-4ed6-ba38-53639c017455 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-450b39b9-b881-47cc-a6f0-05f2cd939f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:53.465670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:53.466927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:53.468082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:53.468082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:53.468082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:53.468696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 329/648] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:53.469474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b39b9-b881-47cc-a6f0-05f2cd939f5a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.498350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84211-f0f0-4abc-bcb4-94295b6ba233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.499189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84211-f0f0-4abc-bcb4-94295b6ba233 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.499471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84211-f0f0-4abc-bcb4-94295b6ba233 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.499809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84211-f0f0-4abc-bcb4-94295b6ba233 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.507858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a84211-f0f0-4abc-bcb4-94295b6ba233 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.509632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a84211-f0f0-4abc-bcb4-94295b6ba233 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e7a84211-f0f0-4abc-bcb4-94295b6ba233 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:53.521465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:53.522693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:53.523940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:53.524537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 320/649] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:53.524991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84211-f0f0-4abc-bcb4-94295b6ba233 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.573625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.592381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b39b9-b881-47cc-a6f0-05f2cd939f5a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.632450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8961-fcd0-400a-8253-d8d43126ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.633072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8961-fcd0-400a-8253-d8d43126ef1b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.633594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8961-fcd0-400a-8253-d8d43126ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.633863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8961-fcd0-400a-8253-d8d43126ef1b None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.634602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8961-fcd0-400a-8253-d8d43126ef1b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:53.634936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8961-fcd0-400a-8253-d8d43126ef1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.636421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8961-fcd0-400a-8253-d8d43126ef1b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.654746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84211-f0f0-4abc-bcb4-94295b6ba233 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.661504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 330/650] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:53.661504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8961-fcd0-400a-8253-d8d43126ef1b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.689070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.698013 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf858b4-346b-4b5f-b7e7-72fc85704658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.698715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf858b4-346b-4b5f-b7e7-72fc85704658 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.699095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf858b4-346b-4b5f-b7e7-72fc85704658 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.699440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf858b4-346b-4b5f-b7e7-72fc85704658 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.700160 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf858b4-346b-4b5f-b7e7-72fc85704658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:53.700534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf858b4-346b-4b5f-b7e7-72fc85704658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.701989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf858b4-346b-4b5f-b7e7-72fc85704658 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.719082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 321/651] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:53.719082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf858b4-346b-4b5f-b7e7-72fc85704658 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.773426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8961-fcd0-400a-8253-d8d43126ef1b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.812603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027278b5-2393-4138-b2b7-eef486d7c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.813173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027278b5-2393-4138-b2b7-eef486d7c044 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.813447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027278b5-2393-4138-b2b7-eef486d7c044 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.813746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027278b5-2393-4138-b2b7-eef486d7c044 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.814375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027278b5-2393-4138-b2b7-eef486d7c044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:53.814677 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027278b5-2393-4138-b2b7-eef486d7c044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.816156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027278b5-2393-4138-b2b7-eef486d7c044 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.828466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf858b4-346b-4b5f-b7e7-72fc85704658 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.834230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 331/652] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:53.834230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027278b5-2393-4138-b2b7-eef486d7c044 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.834230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.871884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91845b-a3ae-4819-bd00-7b0ebfc78983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.872491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91845b-a3ae-4819-bd00-7b0ebfc78983 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.872778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91845b-a3ae-4819-bd00-7b0ebfc78983 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.873047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91845b-a3ae-4819-bd00-7b0ebfc78983 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.873796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91845b-a3ae-4819-bd00-7b0ebfc78983 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:53.874100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91845b-a3ae-4819-bd00-7b0ebfc78983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.875584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91845b-a3ae-4819-bd00-7b0ebfc78983 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.895492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 322/653] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:53.896807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91845b-a3ae-4819-bd00-7b0ebfc78983 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.948224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.957198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027278b5-2393-4138-b2b7-eef486d7c044 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.993957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b5c79-4968-4923-890a-7d1d2c3aa2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.994573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b5c79-4968-4923-890a-7d1d2c3aa2ae None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.994882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b5c79-4968-4923-890a-7d1d2c3aa2ae None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.995154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b5c79-4968-4923-890a-7d1d2c3aa2ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.003306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91845b-a3ae-4819-bd00-7b0ebfc78983 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:54.044351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f4a2e-bf4d-43d9-a157-709aae4af096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:54.045365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f4a2e-bf4d-43d9-a157-709aae4af096 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.045816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f4a2e-bf4d-43d9-a157-709aae4af096 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.046288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f4a2e-bf4d-43d9-a157-709aae4af096 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.054992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f4a2e-bf4d-43d9-a157-709aae4af096 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.056731 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f4a2e-bf4d-43d9-a157-709aae4af096 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.067288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b5c79-4968-4923-890a-7d1d2c3aa2ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.068935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b5c79-4968-4923-890a-7d1d2c3aa2ae None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-963f4a2e-bf4d-43d9-a157-709aae4af096 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:54.069660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:54.070864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:54.072032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:54.072966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.074520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 323/654] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:54.075337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f4a2e-bf4d-43d9-a157-709aae4af096 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.190153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 332/655] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:54.190153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b5c79-4968-4923-890a-7d1d2c3aa2ae None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.200828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f4a2e-bf4d-43d9-a157-709aae4af096 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:54.209075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.241187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ff877-f45b-4cb3-bdfc-f1adb6f8d884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:54.242115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ff877-f45b-4cb3-bdfc-f1adb6f8d884 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.242612 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ff877-f45b-4cb3-bdfc-f1adb6f8d884 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.242914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ff877-f45b-4cb3-bdfc-f1adb6f8d884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.249863 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ff877-f45b-4cb3-bdfc-f1adb6f8d884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.251341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ff877-f45b-4cb3-bdfc-f1adb6f8d884 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-4e3ff877-f45b-4cb3-bdfc-f1adb6f8d884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:54.263051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:54.263998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:54.264912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:54.264912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:54.264912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:54.264912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:54.264912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:54.264912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:54.264912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:54.264912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:54.268883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 324/656] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:54.269714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ff877-f45b-4cb3-bdfc-f1adb6f8d884 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.300885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b5c79-4968-4923-890a-7d1d2c3aa2ae None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:54.303356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.338193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fee55-c4b4-4d81-a07f-000491bf34e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:54.338857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fee55-c4b4-4d81-a07f-000491bf34e4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.339138 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fee55-c4b4-4d81-a07f-000491bf34e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.339433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fee55-c4b4-4d81-a07f-000491bf34e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.386190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ff877-f45b-4cb3-bdfc-f1adb6f8d884 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:54.414522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fee55-c4b4-4d81-a07f-000491bf34e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.416222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fee55-c4b4-4d81-a07f-000491bf34e4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.424241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cade81-1cc2-49ff-80da-eb9ce726359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:54.425085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cade81-1cc2-49ff-80da-eb9ce726359c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.425367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cade81-1cc2-49ff-80da-eb9ce726359c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.425643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cade81-1cc2-49ff-80da-eb9ce726359c None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.427019 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cade81-1cc2-49ff-80da-eb9ce726359c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:54.427329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cade81-1cc2-49ff-80da-eb9ce726359c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.428773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cade81-1cc2-49ff-80da-eb9ce726359c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.447513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 325/657] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:54.447513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cade81-1cc2-49ff-80da-eb9ce726359c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.478086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.545487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 333/658] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:54.545487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fee55-c4b4-4d81-a07f-000491bf34e4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.545487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.564989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cade81-1cc2-49ff-80da-eb9ce726359c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:54.607995 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ba0e3-3668-4e9a-be60-b0bf453c238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:54.608583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ba0e3-3668-4e9a-be60-b0bf453c238d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.608866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ba0e3-3668-4e9a-be60-b0bf453c238d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.609139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ba0e3-3668-4e9a-be60-b0bf453c238d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.620443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ba0e3-3668-4e9a-be60-b0bf453c238d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.621958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ba0e3-3668-4e9a-be60-b0bf453c238d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2b1ba0e3-3668-4e9a-be60-b0bf453c238d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:54.637832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:54.639115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:54.640050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:54.640050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:54.640050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:54.640050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 326/659] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:54.640050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ba0e3-3668-4e9a-be60-b0bf453c238d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.658564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fee55-c4b4-4d81-a07f-000491bf34e4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:54.694069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4540c2a-8e31-4ee9-8f1b-c745965484c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:54.694875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4540c2a-8e31-4ee9-8f1b-c745965484c5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.695092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4540c2a-8e31-4ee9-8f1b-c745965484c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.695354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4540c2a-8e31-4ee9-8f1b-c745965484c5 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.696041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4540c2a-8e31-4ee9-8f1b-c745965484c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:54.696351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4540c2a-8e31-4ee9-8f1b-c745965484c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.697766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4540c2a-8e31-4ee9-8f1b-c745965484c5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.709326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 334/660] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:54.710642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f423859-6e43-4c32-b2dd-f74d1b0d1ee3 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.711065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f423859-6e43-4c32-b2dd-f74d1b0d1ee3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.711404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f423859-6e43-4c32-b2dd-f74d1b0d1ee3 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.714797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 335/661] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:54.714797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f423859-6e43-4c32-b2dd-f74d1b0d1ee3 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.729649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.753915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ba0e3-3668-4e9a-be60-b0bf453c238d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:54.777234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.792570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606cb9-954b-42cd-ba44-68b43b7e3947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:54.793287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606cb9-954b-42cd-ba44-68b43b7e3947 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.793568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606cb9-954b-42cd-ba44-68b43b7e3947 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.793838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606cb9-954b-42cd-ba44-68b43b7e3947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.818925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f423859-6e43-4c32-b2dd-f74d1b0d1ee3 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:54.853583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f371855-1d7b-4a5d-aec0-32191727de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:54.854241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f371855-1d7b-4a5d-aec0-32191727de84 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.854513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f371855-1d7b-4a5d-aec0-32191727de84 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.854799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f371855-1d7b-4a5d-aec0-32191727de84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.863537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f606cb9-954b-42cd-ba44-68b43b7e3947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.865639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f606cb9-954b-42cd-ba44-68b43b7e3947 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.866070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f371855-1d7b-4a5d-aec0-32191727de84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.867553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f371855-1d7b-4a5d-aec0-32191727de84 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4f371855-1d7b-4a5d-aec0-32191727de84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:54.885761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:54.887193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:54.888117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:54.888117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:54.888117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:54.888117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 336/662] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:54.888117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f371855-1d7b-4a5d-aec0-32191727de84 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.953628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.978833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 327/663] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:54.979748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606cb9-954b-42cd-ba44-68b43b7e3947 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.991865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f371855-1d7b-4a5d-aec0-32191727de84 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.005984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.027397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa23869-892c-4f5a-b178-5448e29969f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.028001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23869-892c-4f5a-b178-5448e29969f9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.028272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23869-892c-4f5a-b178-5448e29969f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.028539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23869-892c-4f5a-b178-5448e29969f9 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.029173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa23869-892c-4f5a-b178-5448e29969f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:55.029475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa23869-892c-4f5a-b178-5448e29969f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.030918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa23869-892c-4f5a-b178-5448e29969f9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.044202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 337/664] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:55.048043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae9d4-0eb1-4a89-b34f-fa904d06a39d None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.048332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae9d4-0eb1-4a89-b34f-fa904d06a39d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.048945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae9d4-0eb1-4a89-b34f-fa904d06a39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.065906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-998ae9d4-0eb1-4a89-b34f-fa904d06a39d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:55.067688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-998ae9d4-0eb1-4a89-b34f-fa904d06a39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:55.085759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606cb9-954b-42cd-ba44-68b43b7e3947 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.119972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256d5f6-eded-46a8-a362-f43bff084f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.120790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256d5f6-eded-46a8-a362-f43bff084f09 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.121148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256d5f6-eded-46a8-a362-f43bff084f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.121425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256d5f6-eded-46a8-a362-f43bff084f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.122241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256d5f6-eded-46a8-a362-f43bff084f09 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=d6e704b8291b4934a20cdde2ef127493) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:55.122592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256d5f6-eded-46a8-a362-f43bff084f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.124149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256d5f6-eded-46a8-a362-f43bff084f09 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.130696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 328/665] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/role_assignments?user.id=d6e704b8291b4934a20cdde2ef127493&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:55.131568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256d5f6-eded-46a8-a362-f43bff084f09 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.139326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 338/666] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:55.140451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae9d4-0eb1-4a89-b34f-fa904d06a39d None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.184350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.272102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256d5f6-eded-46a8-a362-f43bff084f09 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.285581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae9d4-0eb1-4a89-b34f-fa904d06a39d None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.289297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.315766 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b236f8-3033-4886-af3a-8e930efff56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.316494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b236f8-3033-4886-af3a-8e930efff56c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.318196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b236f8-3033-4886-af3a-8e930efff56c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.318196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b236f8-3033-4886-af3a-8e930efff56c None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.318578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b236f8-3033-4886-af3a-8e930efff56c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:55.318933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b236f8-3033-4886-af3a-8e930efff56c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.320328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b236f8-3033-4886-af3a-8e930efff56c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.332902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f4208-ba82-4e66-abf7-450e424c6cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.333884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4208-ba82-4e66-abf7-450e424c6cb1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.334436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4208-ba82-4e66-abf7-450e424c6cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.334649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 329/667] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:55.335149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4208-ba82-4e66-abf7-450e424c6cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.335519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b236f8-3033-4886-af3a-8e930efff56c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.349664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f4208-ba82-4e66-abf7-450e424c6cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.351600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f4208-ba82-4e66-abf7-450e424c6cb1 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-3d8f4208-ba82-4e66-abf7-450e424c6cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:55.369703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:55.370928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:55.372046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:55.372046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:55.372046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:55.373170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 339/668] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:55.374054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f4208-ba82-4e66-abf7-450e424c6cb1 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.457536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.460727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b236f8-3033-4886-af3a-8e930efff56c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.494730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f4208-ba82-4e66-abf7-450e424c6cb1 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.502980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef152d7-6b6a-4203-99d4-6ad10145b0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.504153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef152d7-6b6a-4203-99d4-6ad10145b0b5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.505500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef152d7-6b6a-4203-99d4-6ad10145b0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.506315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef152d7-6b6a-4203-99d4-6ad10145b0b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.515125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef152d7-6b6a-4203-99d4-6ad10145b0b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.517021 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef152d7-6b6a-4203-99d4-6ad10145b0b5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.529437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed00ef-01fb-4e08-b15f-f3a7cbd0c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.529996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed00ef-01fb-4e08-b15f-f3a7cbd0c522 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.530272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed00ef-01fb-4e08-b15f-f3a7cbd0c522 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.530538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed00ef-01fb-4e08-b15f-f3a7cbd0c522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1ef152d7-6b6a-4203-99d4-6ad10145b0b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:55.532304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:55.533392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:55.534517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:55.534517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:55.534517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:55.534517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:55.534517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:55.534517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:55.534517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:55.534517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:55.541735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed00ef-01fb-4e08-b15f-f3a7cbd0c522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.542992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 330/669] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:55.544082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed00ef-01fb-4e08-b15f-f3a7cbd0c522 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.545250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef152d7-6b6a-4203-99d4-6ad10145b0b5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-76ed00ef-01fb-4e08-b15f-f3a7cbd0c522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:55.564302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:55.566055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:55.567868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:55.567868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:55.567868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:55.567868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:55.567868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:55.567868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:55.567868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:55.567868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:55.567868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 340/670] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:55.570543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed00ef-01fb-4e08-b15f-f3a7cbd0c522 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.589997 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.670060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef152d7-6b6a-4203-99d4-6ad10145b0b5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.687283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed00ef-01fb-4e08-b15f-f3a7cbd0c522 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.711117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cf60-0905-4b46-88b3-544111bb5aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.711736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cf60-0905-4b46-88b3-544111bb5aeb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.712018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cf60-0905-4b46-88b3-544111bb5aeb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.712289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cf60-0905-4b46-88b3-544111bb5aeb None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.712939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6cf60-0905-4b46-88b3-544111bb5aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:55.713244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6cf60-0905-4b46-88b3-544111bb5aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.714688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6cf60-0905-4b46-88b3-544111bb5aeb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.725448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb65440-8938-48f2-bbad-a3202231939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.726092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65440-8938-48f2-bbad-a3202231939b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.726371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65440-8938-48f2-bbad-a3202231939b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.726641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65440-8938-48f2-bbad-a3202231939b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.731577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 331/671] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:55.731577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cf60-0905-4b46-88b3-544111bb5aeb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.743485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb65440-8938-48f2-bbad-a3202231939b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-8bb65440-8938-48f2-bbad-a3202231939b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:55.748744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:55.750944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 341/672] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:55.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb65440-8938-48f2-bbad-a3202231939b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.760617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.839889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.856071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cf60-0905-4b46-88b3-544111bb5aeb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.869654 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb65440-8938-48f2-bbad-a3202231939b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.896628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713515b9-ee27-4ff0-b43a-71bdcfb008f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.897411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713515b9-ee27-4ff0-b43a-71bdcfb008f7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.897792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713515b9-ee27-4ff0-b43a-71bdcfb008f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.898197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713515b9-ee27-4ff0-b43a-71bdcfb008f7 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.899018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713515b9-ee27-4ff0-b43a-71bdcfb008f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:55.899431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713515b9-ee27-4ff0-b43a-71bdcfb008f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.901033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713515b9-ee27-4ff0-b43a-71bdcfb008f7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.907374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238f2a6-66e9-4411-9eef-e7d474a9788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.908069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238f2a6-66e9-4411-9eef-e7d474a9788c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.908419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238f2a6-66e9-4411-9eef-e7d474a9788c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.908761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238f2a6-66e9-4411-9eef-e7d474a9788c None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.909533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238f2a6-66e9-4411-9eef-e7d474a9788c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:55.909963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238f2a6-66e9-4411-9eef-e7d474a9788c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.912110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238f2a6-66e9-4411-9eef-e7d474a9788c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.920658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 332/673] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:55.920658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713515b9-ee27-4ff0-b43a-71bdcfb008f7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 342/674] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:55.931931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238f2a6-66e9-4411-9eef-e7d474a9788c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.012217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.032296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713515b9-ee27-4ff0-b43a-71bdcfb008f7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.045629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238f2a6-66e9-4411-9eef-e7d474a9788c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.068676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81307ba3-91fe-4c92-b873-31753abc0045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.069398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81307ba3-91fe-4c92-b873-31753abc0045 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.069743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81307ba3-91fe-4c92-b873-31753abc0045 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.070094 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81307ba3-91fe-4c92-b873-31753abc0045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.076892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81307ba3-91fe-4c92-b873-31753abc0045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.078303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81307ba3-91fe-4c92-b873-31753abc0045 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.090002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3b29-88ca-4af9-85f2-5cfa21dd0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.090543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3b29-88ca-4af9-85f2-5cfa21dd0d58 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.090911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3b29-88ca-4af9-85f2-5cfa21dd0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.091182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3b29-88ca-4af9-85f2-5cfa21dd0d58 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.091845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e3b29-88ca-4af9-85f2-5cfa21dd0d58 None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.092141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e3b29-88ca-4af9-85f2-5cfa21dd0d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-81307ba3-91fe-4c92-b873-31753abc0045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:56.092302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:56.093180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:56.100490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:56.100490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:56.100490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:56.100490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:56.100490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:56.100490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:56.100490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:56.100490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:56.100952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e3b29-88ca-4af9-85f2-5cfa21dd0d58 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.101029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 333/675] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:56.101029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81307ba3-91fe-4c92-b873-31753abc0045 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.103169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.103613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 343/676] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:56.104717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3b29-88ca-4af9-85f2-5cfa21dd0d58 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.209686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81307ba3-91fe-4c92-b873-31753abc0045 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.228139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3b29-88ca-4af9-85f2-5cfa21dd0d58 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.249835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6fd5f-380d-4f83-bae3-8567d41b114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.250454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6fd5f-380d-4f83-bae3-8567d41b114f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.250714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6fd5f-380d-4f83-bae3-8567d41b114f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.251079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6fd5f-380d-4f83-bae3-8567d41b114f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.251854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6fd5f-380d-4f83-bae3-8567d41b114f None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=3da4ea5ad2924cf4baef5614929b7e7a) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.252184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6fd5f-380d-4f83-bae3-8567d41b114f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.253805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6fd5f-380d-4f83-bae3-8567d41b114f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.261785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 334/677] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/role_assignments?user.id=3da4ea5ad2924cf4baef5614929b7e7a&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:56.262695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6fd5f-380d-4f83-bae3-8567d41b114f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.267692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.271632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f5805-55fb-40ae-beca-5686d295c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.272627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f5805-55fb-40ae-beca-5686d295c218 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.273134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f5805-55fb-40ae-beca-5686d295c218 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.273603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f5805-55fb-40ae-beca-5686d295c218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.274583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f5805-55fb-40ae-beca-5686d295c218 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=0d4e9baa7a6241b1807c67844c7d424c) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.275137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f5805-55fb-40ae-beca-5686d295c218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.277601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f5805-55fb-40ae-beca-5686d295c218 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.288803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 344/678] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/role_assignments?user.id=0d4e9baa7a6241b1807c67844c7d424c&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:56.290502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f5805-55fb-40ae-beca-5686d295c218 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.385835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.403972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6fd5f-380d-4f83-bae3-8567d41b114f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.446406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f5805-55fb-40ae-beca-5686d295c218 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.453743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aca02-5bc2-4f28-8c88-e9c68b940243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.455466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aca02-5bc2-4f28-8c88-e9c68b940243 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.455974 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aca02-5bc2-4f28-8c88-e9c68b940243 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.456460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aca02-5bc2-4f28-8c88-e9c68b940243 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.457426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aca02-5bc2-4f28-8c88-e9c68b940243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.458795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aca02-5bc2-4f28-8c88-e9c68b940243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.460961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aca02-5bc2-4f28-8c88-e9c68b940243 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.479995 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 335/679] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:56.486722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aca02-5bc2-4f28-8c88-e9c68b940243 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.492507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cd498-5793-4114-97c9-a1e53369015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.492507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cd498-5793-4114-97c9-a1e53369015a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.492816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cd498-5793-4114-97c9-a1e53369015a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.493125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cd498-5793-4114-97c9-a1e53369015a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.507550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cd498-5793-4114-97c9-a1e53369015a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.509771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cd498-5793-4114-97c9-a1e53369015a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-ce9cd498-5793-4114-97c9-a1e53369015a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:56.527356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:56.528403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:56.529320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:56.529320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:56.529320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:56.529320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 345/680] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:56.540331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cd498-5793-4114-97c9-a1e53369015a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.567286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.612605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aca02-5bc2-4f28-8c88-e9c68b940243 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.659093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8829-702f-4258-a4c1-b73a002ab490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.659993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8829-702f-4258-a4c1-b73a002ab490 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.660480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8829-702f-4258-a4c1-b73a002ab490 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.661416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8829-702f-4258-a4c1-b73a002ab490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.662171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db8829-702f-4258-a4c1-b73a002ab490 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=c13c571a4bd24335b8b149825bd79d71) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.662480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db8829-702f-4258-a4c1-b73a002ab490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.664168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db8829-702f-4258-a4c1-b73a002ab490 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.671338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 336/681] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/role_assignments?user.id=c13c571a4bd24335b8b149825bd79d71&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:56.677387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cd498-5793-4114-97c9-a1e53369015a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.697187 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.726138 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77b5eb-16fe-42cd-9586-57e4f7cc8708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.727239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77b5eb-16fe-42cd-9586-57e4f7cc8708 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.727733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77b5eb-16fe-42cd-9586-57e4f7cc8708 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.728369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77b5eb-16fe-42cd-9586-57e4f7cc8708 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.729190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77b5eb-16fe-42cd-9586-57e4f7cc8708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.729608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77b5eb-16fe-42cd-9586-57e4f7cc8708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.731262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77b5eb-16fe-42cd-9586-57e4f7cc8708 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.750928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 346/682] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:56.756782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8829-702f-4258-a4c1-b73a002ab490 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.910055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8829-702f-4258-a4c1-b73a002ab490 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.945578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.954906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609a4b7-b7cd-4f47-89e9-6046612c3e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.956029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609a4b7-b7cd-4f47-89e9-6046612c3e27 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.956603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609a4b7-b7cd-4f47-89e9-6046612c3e27 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.957617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609a4b7-b7cd-4f47-89e9-6046612c3e27 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.968192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609a4b7-b7cd-4f47-89e9-6046612c3e27 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.969657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609a4b7-b7cd-4f47-89e9-6046612c3e27 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-b609a4b7-b7cd-4f47-89e9-6046612c3e27 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:56.983785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:56.984793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:56.985737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 337/683] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:56.991697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77b5eb-16fe-42cd-9586-57e4f7cc8708 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:57.124850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77b5eb-16fe-42cd-9586-57e4f7cc8708 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:57.180439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adea96e-b2d7-466f-81a9-ae3525ef024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:57.181068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adea96e-b2d7-466f-81a9-ae3525ef024c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.181343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adea96e-b2d7-466f-81a9-ae3525ef024c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.181610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adea96e-b2d7-466f-81a9-ae3525ef024c None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.182343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adea96e-b2d7-466f-81a9-ae3525ef024c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:57.182643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adea96e-b2d7-466f-81a9-ae3525ef024c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:57.184082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adea96e-b2d7-466f-81a9-ae3525ef024c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:57.210459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 347/684] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:57.214943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843522b-3b21-49f1-aa79-773b5c2b24d7 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.215228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843522b-3b21-49f1-aa79-773b5c2b24d7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.215494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843522b-3b21-49f1-aa79-773b5c2b24d7 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.216811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 338/685] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:57.219316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adea96e-b2d7-466f-81a9-ae3525ef024c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:57.221806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecdf8a-4fe8-458e-a895-ce0037e541c6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.222086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecdf8a-4fe8-458e-a895-ce0037e541c6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.222367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecdf8a-4fe8-458e-a895-ce0037e541c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.247383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-36ecdf8a-4fe8-458e-a895-ce0037e541c6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:57.249407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-36ecdf8a-4fe8-458e-a895-ce0037e541c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:57.275229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:57.375953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 339/686] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:57.391834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adea96e-b2d7-466f-81a9-ae3525ef024c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:57.442461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41317fe1-0546-42ba-89a3-81f2069dbf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:57.443459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41317fe1-0546-42ba-89a3-81f2069dbf0b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.443937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41317fe1-0546-42ba-89a3-81f2069dbf0b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.444404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41317fe1-0546-42ba-89a3-81f2069dbf0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.521175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41317fe1-0546-42ba-89a3-81f2069dbf0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:57.522621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41317fe1-0546-42ba-89a3-81f2069dbf0b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:57.553876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:57.636938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 348/687] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:57.642087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecdf8a-4fe8-458e-a895-ce0037e541c6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:57.763848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecdf8a-4fe8-458e-a895-ce0037e541c6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:57.782916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:57.797732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41317fe1-0546-42ba-89a3-81f2069dbf0b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:57.812503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65322ef-2617-4afe-97bf-a188ebb970ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:57.813635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65322ef-2617-4afe-97bf-a188ebb970ab None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.813915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65322ef-2617-4afe-97bf-a188ebb970ab None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.814188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65322ef-2617-4afe-97bf-a188ebb970ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.828907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65322ef-2617-4afe-97bf-a188ebb970ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:57.830645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65322ef-2617-4afe-97bf-a188ebb970ab None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-b65322ef-2617-4afe-97bf-a188ebb970ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:57.848661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:57.849693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:57.850588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:57.850588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:57.850588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:57.850588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 340/688] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:57.856316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65322ef-2617-4afe-97bf-a188ebb970ab None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:57.976587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41317fe1-0546-42ba-89a3-81f2069dbf0b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.007642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:58.014891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15174e98-d68d-4a46-a5e0-f7e2db0e7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.015464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15174e98-d68d-4a46-a5e0-f7e2db0e7b82 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.015739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15174e98-d68d-4a46-a5e0-f7e2db0e7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.016008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15174e98-d68d-4a46-a5e0-f7e2db0e7b82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.027220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15174e98-d68d-4a46-a5e0-f7e2db0e7b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-15174e98-d68d-4a46-a5e0-f7e2db0e7b82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:58.032135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:58.033077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:58.033933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 349/689] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:58.040131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15174e98-d68d-4a46-a5e0-f7e2db0e7b82 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.070320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65322ef-2617-4afe-97bf-a188ebb970ab None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.150173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15174e98-d68d-4a46-a5e0-f7e2db0e7b82 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.151465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215a4d1-896e-45fc-b8e3-2e18b10ff45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.152100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215a4d1-896e-45fc-b8e3-2e18b10ff45c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.152385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215a4d1-896e-45fc-b8e3-2e18b10ff45c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.152665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215a4d1-896e-45fc-b8e3-2e18b10ff45c None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.153326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215a4d1-896e-45fc-b8e3-2e18b10ff45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:58.153632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215a4d1-896e-45fc-b8e3-2e18b10ff45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.155043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215a4d1-896e-45fc-b8e3-2e18b10ff45c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.179278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 341/690] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:58.185749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215a4d1-896e-45fc-b8e3-2e18b10ff45c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.191229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8bead-e5b0-4f71-a17e-4291af5daee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.192409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8bead-e5b0-4f71-a17e-4291af5daee7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.192686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8bead-e5b0-4f71-a17e-4291af5daee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.192947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8bead-e5b0-4f71-a17e-4291af5daee7 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.193615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8bead-e5b0-4f71-a17e-4291af5daee7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:58.193915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8bead-e5b0-4f71-a17e-4291af5daee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.195385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8bead-e5b0-4f71-a17e-4291af5daee7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.204641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 350/691] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:58.210595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8bead-e5b0-4f71-a17e-4291af5daee7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.274990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:58.279245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:58.326720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8bead-e5b0-4f71-a17e-4291af5daee7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.364308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94481e76-3cc3-4c33-b495-b2ead5837c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.365394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94481e76-3cc3-4c33-b495-b2ead5837c10 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.365870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94481e76-3cc3-4c33-b495-b2ead5837c10 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.366396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94481e76-3cc3-4c33-b495-b2ead5837c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.367484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215a4d1-896e-45fc-b8e3-2e18b10ff45c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.378499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94481e76-3cc3-4c33-b495-b2ead5837c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.380315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94481e76-3cc3-4c33-b495-b2ead5837c10 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-94481e76-3cc3-4c33-b495-b2ead5837c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:58.396635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:58.397754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:58.398659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:58.398659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:58.398659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:58.401045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 351/692] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:58.406820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94481e76-3cc3-4c33-b495-b2ead5837c10 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.444424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468218e-b443-444d-9a22-9db6bfeb6962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.445152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468218e-b443-444d-9a22-9db6bfeb6962 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.445352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468218e-b443-444d-9a22-9db6bfeb6962 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.445624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468218e-b443-444d-9a22-9db6bfeb6962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.458009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468218e-b443-444d-9a22-9db6bfeb6962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.459524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468218e-b443-444d-9a22-9db6bfeb6962 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-3468218e-b443-444d-9a22-9db6bfeb6962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:58.491120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:58.492108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:58.493003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:58.493003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:58.493003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:58.493003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:58.493003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:58.493003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:58.493003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:58.493003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:58.493003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 342/693] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:58.503815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468218e-b443-444d-9a22-9db6bfeb6962 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.529534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94481e76-3cc3-4c33-b495-b2ead5837c10 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.539047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:58.572612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419a2fc-39e0-4fd0-8e94-dc37948505a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.574238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419a2fc-39e0-4fd0-8e94-dc37948505a7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.574969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419a2fc-39e0-4fd0-8e94-dc37948505a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.576139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419a2fc-39e0-4fd0-8e94-dc37948505a7 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.577164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419a2fc-39e0-4fd0-8e94-dc37948505a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:58.578657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419a2fc-39e0-4fd0-8e94-dc37948505a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.580549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419a2fc-39e0-4fd0-8e94-dc37948505a7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.607923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 352/694] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:58.615212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419a2fc-39e0-4fd0-8e94-dc37948505a7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.673007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:58.690346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468218e-b443-444d-9a22-9db6bfeb6962 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.753746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dce0bc-d827-4ce0-b433-8d59b4e2d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.755042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce0bc-d827-4ce0-b433-8d59b4e2d037 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.755358 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce0bc-d827-4ce0-b433-8d59b4e2d037 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.755628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce0bc-d827-4ce0-b433-8d59b4e2d037 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.756323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dce0bc-d827-4ce0-b433-8d59b4e2d037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:58.756626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dce0bc-d827-4ce0-b433-8d59b4e2d037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.758074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dce0bc-d827-4ce0-b433-8d59b4e2d037 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.793097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 343/695] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:58.793707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419a2fc-39e0-4fd0-8e94-dc37948505a7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.799487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dce0bc-d827-4ce0-b433-8d59b4e2d037 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.844292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b157-e454-452c-b4f9-187b5fb0e43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.845247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b157-e454-452c-b4f9-187b5fb0e43a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.845702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b157-e454-452c-b4f9-187b5fb0e43a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.846173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b157-e454-452c-b4f9-187b5fb0e43a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.863338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10b157-e454-452c-b4f9-187b5fb0e43a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.865948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10b157-e454-452c-b4f9-187b5fb0e43a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-5a10b157-e454-452c-b4f9-187b5fb0e43a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:58.884608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:58.885650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:58.886623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:58.889426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 353/696] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:58.896093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b157-e454-452c-b4f9-187b5fb0e43a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.938282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:58.945930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dce0bc-d827-4ce0-b433-8d59b4e2d037 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.998505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11710-507e-4818-a0f7-4c813937b21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.999240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11710-507e-4818-a0f7-4c813937b21a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.999585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11710-507e-4818-a0f7-4c813937b21a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.000218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11710-507e-4818-a0f7-4c813937b21a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.001379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11710-507e-4818-a0f7-4c813937b21a None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=7345509ac3604cf99c0e9ef232afcd09) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:59.001699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11710-507e-4818-a0f7-4c813937b21a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.003435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11710-507e-4818-a0f7-4c813937b21a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.018799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 344/697] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/role_assignments?user.id=7345509ac3604cf99c0e9ef232afcd09&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:59.018799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee99428-fb36-4c6e-abd8-e31dea28db53 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.018799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee99428-fb36-4c6e-abd8-e31dea28db53 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.018799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee99428-fb36-4c6e-abd8-e31dea28db53 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.018799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 345/698] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:59.022039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47005d34-49ba-4a8a-bba6-3b895ab36b49 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.022433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47005d34-49ba-4a8a-bba6-3b895ab36b49 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.022742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47005d34-49ba-4a8a-bba6-3b895ab36b49 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.024598 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 346/699] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:59.025872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b7b9e-2fc1-466c-ad35-834479af2bee None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.026159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b7b9e-2fc1-466c-ad35-834479af2bee None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.026433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b7b9e-2fc1-466c-ad35-834479af2bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.034231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b157-e454-452c-b4f9-187b5fb0e43a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.048028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-153b7b9e-2fc1-466c-ad35-834479af2bee None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:59.049496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-153b7b9e-2fc1-466c-ad35-834479af2bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:59.061115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.072762 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb4e0d-42f6-41d7-8aed-86d32cd6bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.073392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4e0d-42f6-41d7-8aed-86d32cd6bf80 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.073668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4e0d-42f6-41d7-8aed-86d32cd6bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.073942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4e0d-42f6-41d7-8aed-86d32cd6bf80 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.074684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb4e0d-42f6-41d7-8aed-86d32cd6bf80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:59.075020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb4e0d-42f6-41d7-8aed-86d32cd6bf80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.076723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb4e0d-42f6-41d7-8aed-86d32cd6bf80 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.097380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 354/700] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:59.099320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53a50-6c97-4df1-875b-0c204a691165 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.099607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53a50-6c97-4df1-875b-0c204a691165 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.099881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53a50-6c97-4df1-875b-0c204a691165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.119619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-38d53a50-6c97-4df1-875b-0c204a691165 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:59.120868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-38d53a50-6c97-4df1-875b-0c204a691165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:59.138939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 347/701] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:59.140102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b7b9e-2fc1-466c-ad35-834479af2bee None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.215149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 355/702] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:59.246585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1b30-3848-4dba-bdf0-25cbc9adbb20 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.246971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1b30-3848-4dba-bdf0-25cbc9adbb20 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.247175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1b30-3848-4dba-bdf0-25cbc9adbb20 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.248636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 356/703] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:59.255828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e21ce5-8681-4d11-9ad7-a98f776dc011 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.256395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e21ce5-8681-4d11-9ad7-a98f776dc011 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.256913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e21ce5-8681-4d11-9ad7-a98f776dc011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.281511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a9e21ce5-8681-4d11-9ad7-a98f776dc011 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:59.283554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a9e21ce5-8681-4d11-9ad7-a98f776dc011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:59.290004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b7b9e-2fc1-466c-ad35-834479af2bee None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.296660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.333787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16236e-56c7-4f00-a4f0-f8431bf10c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.334813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16236e-56c7-4f00-a4f0-f8431bf10c77 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.335304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16236e-56c7-4f00-a4f0-f8431bf10c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.335788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16236e-56c7-4f00-a4f0-f8431bf10c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.352540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.378802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 357/704] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:59.414129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16236e-56c7-4f00-a4f0-f8431bf10c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.415608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16236e-56c7-4f00-a4f0-f8431bf10c77 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.443387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e21ce5-8681-4d11-9ad7-a98f776dc011 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.534959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 348/705] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:59.538617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16236e-56c7-4f00-a4f0-f8431bf10c77 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.591593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e21ce5-8681-4d11-9ad7-a98f776dc011 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.598789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.642702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b8cc2-2291-47d2-80b6-ed3d940a2249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.643379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b8cc2-2291-47d2-80b6-ed3d940a2249 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.643659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b8cc2-2291-47d2-80b6-ed3d940a2249 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.643932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b8cc2-2291-47d2-80b6-ed3d940a2249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.658419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16236e-56c7-4f00-a4f0-f8431bf10c77 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.662593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b8cc2-2291-47d2-80b6-ed3d940a2249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.664368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b8cc2-2291-47d2-80b6-ed3d940a2249 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.667796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-b73b8cc2-2291-47d2-80b6-ed3d940a2249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:59.684817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:59.685846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:59.686807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:59.686807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:59.686807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:59.686807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 358/706] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:59.686807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b8cc2-2291-47d2-80b6-ed3d940a2249 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.703307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb48de-9e22-4715-abb3-c361df7f008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.703948 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb48de-9e22-4715-abb3-c361df7f008d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.704226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb48de-9e22-4715-abb3-c361df7f008d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.704499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb48de-9e22-4715-abb3-c361df7f008d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.705082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb48de-9e22-4715-abb3-c361df7f008d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.706441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb48de-9e22-4715-abb3-c361df7f008d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-77cb48de-9e22-4715-abb3-c361df7f008d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:59.717007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:59.718077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:59.718984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 349/707] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:59.719808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb48de-9e22-4715-abb3-c361df7f008d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.798976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b8cc2-2291-47d2-80b6-ed3d940a2249 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.830978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb48de-9e22-4715-abb3-c361df7f008d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.836296 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428ff2-2fff-48e3-984e-22aa0a4ac4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.837199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428ff2-2fff-48e3-984e-22aa0a4ac4cd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.837655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428ff2-2fff-48e3-984e-22aa0a4ac4cd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.838111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428ff2-2fff-48e3-984e-22aa0a4ac4cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.840444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.852177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41428ff2-2fff-48e3-984e-22aa0a4ac4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.853568 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41428ff2-2fff-48e3-984e-22aa0a4ac4cd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-41428ff2-2fff-48e3-984e-22aa0a4ac4cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:59.869310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:59.870376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:59.871345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:59.871345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:59.871345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:34:59.871345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 359/708] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:59.871581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428ff2-2fff-48e3-984e-22aa0a4ac4cd None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.877670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d10f7-be97-44c9-b639-7414c0acb78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.878322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d10f7-be97-44c9-b639-7414c0acb78d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.878611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d10f7-be97-44c9-b639-7414c0acb78d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.878926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d10f7-be97-44c9-b639-7414c0acb78d None admin] PATH_INFO: `/v3/services/network` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.879858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d10f7-be97-44c9-b639-7414c0acb78d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.881447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d10f7-be97-44c9-b639-7414c0acb78d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-a85d10f7-be97-44c9-b639-7414c0acb78d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:59.892407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:59.893480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:34:59.894329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 350/709] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:59.895670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d10f7-be97-44c9-b639-7414c0acb78d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.940184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.001585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428ff2-2fff-48e3-984e-22aa0a4ac4cd None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.012789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d10f7-be97-44c9-b639-7414c0acb78d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.038629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8a5fa-0968-4806-a577-c273b206edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.039421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8a5fa-0968-4806-a577-c273b206edd0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.039701 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8a5fa-0968-4806-a577-c273b206edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.040292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8a5fa-0968-4806-a577-c273b206edd0 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.040942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8a5fa-0968-4806-a577-c273b206edd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.041230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8a5fa-0968-4806-a577-c273b206edd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.042806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8a5fa-0968-4806-a577-c273b206edd0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.052488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5144cc-36f6-4f02-9bf5-f927f049a449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.053140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5144cc-36f6-4f02-9bf5-f927f049a449 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.053405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5144cc-36f6-4f02-9bf5-f927f049a449 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.053668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5144cc-36f6-4f02-9bf5-f927f049a449 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.054304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5144cc-36f6-4f02-9bf5-f927f049a449 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.054609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5144cc-36f6-4f02-9bf5-f927f049a449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.056031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5144cc-36f6-4f02-9bf5-f927f049a449 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.061489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 360/710] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:00.061489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8a5fa-0968-4806-a577-c273b206edd0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.065823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 351/711] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:00.070810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5144cc-36f6-4f02-9bf5-f927f049a449 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.105116 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.168070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8a5fa-0968-4806-a577-c273b206edd0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.177256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5144cc-36f6-4f02-9bf5-f927f049a449 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.180413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.210435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e7592-94e9-49e5-9548-01e7377f4a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.211084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e7592-94e9-49e5-9548-01e7377f4a27 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.211360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e7592-94e9-49e5-9548-01e7377f4a27 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.211625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e7592-94e9-49e5-9548-01e7377f4a27 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.212291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e7592-94e9-49e5-9548-01e7377f4a27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.212594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e7592-94e9-49e5-9548-01e7377f4a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.213973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e7592-94e9-49e5-9548-01e7377f4a27 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.220118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bf82f-4438-4bca-b60b-33d7a5e285c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.220723 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bf82f-4438-4bca-b60b-33d7a5e285c3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.221502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bf82f-4438-4bca-b60b-33d7a5e285c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.221780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bf82f-4438-4bca-b60b-33d7a5e285c3 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.222421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bf82f-4438-4bca-b60b-33d7a5e285c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.222805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bf82f-4438-4bca-b60b-33d7a5e285c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.225046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bf82f-4438-4bca-b60b-33d7a5e285c3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.231376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 361/712] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:00.231376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e7592-94e9-49e5-9548-01e7377f4a27 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.231607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 352/713] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:00.232570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bf82f-4438-4bca-b60b-33d7a5e285c3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.341811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.345093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bf82f-4438-4bca-b60b-33d7a5e285c3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.350436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e7592-94e9-49e5-9548-01e7377f4a27 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.380919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6d6f-d7f0-4218-b951-9861fb964ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.381451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6d6f-d7f0-4218-b951-9861fb964ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.381734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6d6f-d7f0-4218-b951-9861fb964ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.382006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6d6f-d7f0-4218-b951-9861fb964ab4 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.382643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6d6f-d7f0-4218-b951-9861fb964ab4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.382978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6d6f-d7f0-4218-b951-9861fb964ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.384607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6d6f-d7f0-4218-b951-9861fb964ab4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.390452 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 353/714] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:00.391502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6d6f-d7f0-4218-b951-9861fb964ab4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.400116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc3d74-b883-4ff3-a4ec-6e661989fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.401085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3d74-b883-4ff3-a4ec-6e661989fe33 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.401552 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3d74-b883-4ff3-a4ec-6e661989fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.402153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3d74-b883-4ff3-a4ec-6e661989fe33 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.403022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc3d74-b883-4ff3-a4ec-6e661989fe33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.404770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc3d74-b883-4ff3-a4ec-6e661989fe33 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.436777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 362/715] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:35:00 2022] POST /identity/v3/users => generated 254 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:00.438038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc3d74-b883-4ff3-a4ec-6e661989fe33 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.472768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.544620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6d6f-d7f0-4218-b951-9861fb964ab4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.588261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc3d74-b883-4ff3-a4ec-6e661989fe33 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.588924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254306-588c-4cb9-a7e9-5dec1c687613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.589685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254306-588c-4cb9-a7e9-5dec1c687613 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.590104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254306-588c-4cb9-a7e9-5dec1c687613 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.590475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254306-588c-4cb9-a7e9-5dec1c687613 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.598622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82254306-588c-4cb9-a7e9-5dec1c687613 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.600353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82254306-588c-4cb9-a7e9-5dec1c687613 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-82254306-588c-4cb9-a7e9-5dec1c687613 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:00.614343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:00.615624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:00.616771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:00.616771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:00.616771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:00.616771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:00.616771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:00.616771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:00.616771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:00.616771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:00.618708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 354/716] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:00.624548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254306-588c-4cb9-a7e9-5dec1c687613 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.645322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a0796-9ed6-4aca-be23-0a560bcd3da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.647684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a0796-9ed6-4aca-be23-0a560bcd3da5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.648591 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a0796-9ed6-4aca-be23-0a560bcd3da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.650057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a0796-9ed6-4aca-be23-0a560bcd3da5 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.651979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a0796-9ed6-4aca-be23-0a560bcd3da5 None admin] RBAC: Adding query filter params (type=network) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.653160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a0796-9ed6-4aca-be23-0a560bcd3da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.654756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a0796-9ed6-4aca-be23-0a560bcd3da5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.669208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 363/717] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:00.674657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.771491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254306-588c-4cb9-a7e9-5dec1c687613 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.812953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a32de-6428-4926-aff9-6b8e41c74e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.813582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a32de-6428-4926-aff9-6b8e41c74e7e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.813862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a32de-6428-4926-aff9-6b8e41c74e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.814132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a32de-6428-4926-aff9-6b8e41c74e7e None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.814865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a32de-6428-4926-aff9-6b8e41c74e7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.815173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a32de-6428-4926-aff9-6b8e41c74e7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.816923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a32de-6428-4926-aff9-6b8e41c74e7e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.834291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 355/718] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:00.840327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a0796-9ed6-4aca-be23-0a560bcd3da5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.947695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.960729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a0796-9ed6-4aca-be23-0a560bcd3da5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.997109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c5ad4-b2d1-43b3-98fa-987d73c76570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.997731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c5ad4-b2d1-43b3-98fa-987d73c76570 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.998008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c5ad4-b2d1-43b3-98fa-987d73c76570 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.998330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c5ad4-b2d1-43b3-98fa-987d73c76570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.999109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c5ad4-b2d1-43b3-98fa-987d73c76570 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=d6e704b8291b4934a20cdde2ef127493) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.999419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c5ad4-b2d1-43b3-98fa-987d73c76570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:01.000913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c5ad4-b2d1-43b3-98fa-987d73c76570 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:01.008563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 364/719] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/role_assignments?user.id=d6e704b8291b4934a20cdde2ef127493&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:01.479959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad2154-c4fc-4328-bc27-22d1583cf7f2 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:01.480344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad2154-c4fc-4328-bc27-22d1583cf7f2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:01.480525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad2154-c4fc-4328-bc27-22d1583cf7f2 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:01.482096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 356/720] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:01.487135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e60d-2be7-414f-9850-ac06e99f430f None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:01.487624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e60d-2be7-414f-9850-ac06e99f430f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:01.487706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e60d-2be7-414f-9850-ac06e99f430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:01.509943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8734e60d-2be7-414f-9850-ac06e99f430f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:01.511803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8734e60d-2be7-414f-9850-ac06e99f430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:01.609712 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 365/721] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:35:01.969167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad2154-c4fc-4328-bc27-22d1583cf7f2 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.092866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.116074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad2154-c4fc-4328-bc27-22d1583cf7f2 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.160971 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff94db-0385-4558-bbaf-fb7b3fb06458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.161627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff94db-0385-4558-bbaf-fb7b3fb06458 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.161907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff94db-0385-4558-bbaf-fb7b3fb06458 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.162179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff94db-0385-4558-bbaf-fb7b3fb06458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.188541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff94db-0385-4558-bbaf-fb7b3fb06458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-39ff94db-0385-4558-bbaf-fb7b3fb06458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:02.194523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:02.195761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:02.196640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 357/722] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:02.203989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734e60d-2be7-414f-9850-ac06e99f430f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.339346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.369594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734e60d-2be7-414f-9850-ac06e99f430f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.423775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902f33-9c72-4bcb-a920-ad362b8de325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.424803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902f33-9c72-4bcb-a920-ad362b8de325 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.425288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902f33-9c72-4bcb-a920-ad362b8de325 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.425756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902f33-9c72-4bcb-a920-ad362b8de325 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.427607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902f33-9c72-4bcb-a920-ad362b8de325 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:02.428123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902f33-9c72-4bcb-a920-ad362b8de325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.429708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902f33-9c72-4bcb-a920-ad362b8de325 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.442846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 366/723] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:02.448636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff94db-0385-4558-bbaf-fb7b3fb06458 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.627217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff94db-0385-4558-bbaf-fb7b3fb06458 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.681355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6501436-a6ae-40ff-ae94-7cc487477302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.682000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6501436-a6ae-40ff-ae94-7cc487477302 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.682342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6501436-a6ae-40ff-ae94-7cc487477302 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.682625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6501436-a6ae-40ff-ae94-7cc487477302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.696154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6501436-a6ae-40ff-ae94-7cc487477302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.697685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6501436-a6ae-40ff-ae94-7cc487477302 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.701322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f6501436-a6ae-40ff-ae94-7cc487477302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:02.715457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:02.716541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:02.717466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:02.717466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:02.717466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:02.717466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 358/724] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:02.724452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902f33-9c72-4bcb-a920-ad362b8de325 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.865611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902f33-9c72-4bcb-a920-ad362b8de325 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.925336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cb953-ebbd-4b46-abd5-9c80bc1c6412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.926506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cb953-ebbd-4b46-abd5-9c80bc1c6412 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.926820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cb953-ebbd-4b46-abd5-9c80bc1c6412 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.927076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cb953-ebbd-4b46-abd5-9c80bc1c6412 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.928038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cb953-ebbd-4b46-abd5-9c80bc1c6412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:02.928340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cb953-ebbd-4b46-abd5-9c80bc1c6412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.929730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cb953-ebbd-4b46-abd5-9c80bc1c6412 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.947669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 367/725] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:02.953410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6501436-a6ae-40ff-ae94-7cc487477302 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:03.037247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3a0f-2491-4e51-8a97-cca050546247 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.037598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3a0f-2491-4e51-8a97-cca050546247 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.038112 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3a0f-2491-4e51-8a97-cca050546247 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.041533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 368/726] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:03.046674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6de0-dad5-4b08-93da-30a9be3dd21e None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.047541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6de0-dad5-4b08-93da-30a9be3dd21e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.048156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6de0-dad5-4b08-93da-30a9be3dd21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.056932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:03.071228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ba0d6de0-dad5-4b08-93da-30a9be3dd21e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:03.072868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ba0d6de0-dad5-4b08-93da-30a9be3dd21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:03.146321 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6501436-a6ae-40ff-ae94-7cc487477302 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:03.156322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 369/727] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:35:03.157879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9587e-61ce-4f81-be87-3d3b4445a9f1 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.158307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9587e-61ce-4f81-be87-3d3b4445a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.158706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9587e-61ce-4f81-be87-3d3b4445a9f1 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.160900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 370/728] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:03.166486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f8680-55a2-478b-bed6-a241d2a44c4b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.166968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f8680-55a2-478b-bed6-a241d2a44c4b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.167387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f8680-55a2-478b-bed6-a241d2a44c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.188418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-313f8680-55a2-478b-bed6-a241d2a44c4b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:03.190183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-313f8680-55a2-478b-bed6-a241d2a44c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:03.206780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739891-60e2-4699-b497-bf5a3f0a2f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:03.207866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739891-60e2-4699-b497-bf5a3f0a2f32 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.208327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739891-60e2-4699-b497-bf5a3f0a2f32 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.208723 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739891-60e2-4699-b497-bf5a3f0a2f32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.225310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53739891-60e2-4699-b497-bf5a3f0a2f32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:03.227107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53739891-60e2-4699-b497-bf5a3f0a2f32 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-53739891-60e2-4699-b497-bf5a3f0a2f32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:03.246734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:03.247833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:35:03.248787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:03.252379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 359/729] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:03.254815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739891-60e2-4699-b497-bf5a3f0a2f32 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:03.273172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 371/730] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:35:03.389255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:03.428200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e122-91ef-41b4-8ec8-828fdca8c9b4 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.428519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e122-91ef-41b4-8ec8-828fdca8c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.428751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e122-91ef-41b4-8ec8-828fdca8c9b4 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.430261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 372/731] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:03.435073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f386e4-6f19-4d02-ade2-d7f3f4f9dc4d None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.435352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f386e4-6f19-4d02-ade2-d7f3f4f9dc4d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.435608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f386e4-6f19-4d02-ade2-d7f3f4f9dc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.466477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739891-60e2-4699-b497-bf5a3f0a2f32 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:03.471614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a1f386e4-6f19-4d02-ade2-d7f3f4f9dc4d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:03.473388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a1f386e4-6f19-4d02-ade2-d7f3f4f9dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:03.509657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dadff8-87cc-4d6e-a616-82d62ac33a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:03.510722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dadff8-87cc-4d6e-a616-82d62ac33a37 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.511424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dadff8-87cc-4d6e-a616-82d62ac33a37 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.512106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dadff8-87cc-4d6e-a616-82d62ac33a37 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.512975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dadff8-87cc-4d6e-a616-82d62ac33a37 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:03.513351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dadff8-87cc-4d6e-a616-82d62ac33a37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:03.514911 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dadff8-87cc-4d6e-a616-82d62ac33a37 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:03.540267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 360/732] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Aug 18 20:35:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:03.540267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3f09c-7d8e-4be2-807c-c4616cb2349f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.540267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3f09c-7d8e-4be2-807c-c4616cb2349f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.540267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3f09c-7d8e-4be2-807c-c4616cb2349f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.540267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 361/733] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:03.541373 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3f09c-7d8e-4be2-807c-c4616cb2349f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:03.548461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:03.563120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 373/734] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:35:03.564567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f386e4-6f19-4d02-ade2-d7f3f4f9dc4d None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:03.669500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3f09c-7d8e-4be2-807c-c4616cb2349f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:03.685696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:03.705724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f386e4-6f19-4d02-ade2-d7f3f4f9dc4d None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:03.713171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053b83-c286-4b00-867c-a367606f89f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:03.714628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053b83-c286-4b00-867c-a367606f89f9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.714939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053b83-c286-4b00-867c-a367606f89f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.715217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053b83-c286-4b00-867c-a367606f89f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.744685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19530ce0-f15f-480e-9c81-a2f6d0a0e723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:03.745303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530ce0-f15f-480e-9c81-a2f6d0a0e723 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.745577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530ce0-f15f-480e-9c81-a2f6d0a0e723 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.745849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530ce0-f15f-480e-9c81-a2f6d0a0e723 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.746486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19530ce0-f15f-480e-9c81-a2f6d0a0e723 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:03.747887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19530ce0-f15f-480e-9c81-a2f6d0a0e723 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:03.766115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 374/735] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:03 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:03.767273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b0be-3dbb-4762-958a-6edb560d46d1 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.767559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b0be-3dbb-4762-958a-6edb560d46d1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.767833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b0be-3dbb-4762-958a-6edb560d46d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.790209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0d76b0be-3dbb-4762-958a-6edb560d46d1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:03.790209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0d76b0be-3dbb-4762-958a-6edb560d46d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:03.802742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053b83-c286-4b00-867c-a367606f89f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:03.804403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053b83-c286-4b00-867c-a367606f89f9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:03.857194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:03.895441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 375/736] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:35:03.896446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76b0be-3dbb-4762-958a-6edb560d46d1 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:03.938240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 362/737] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:35:03.939503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053b83-c286-4b00-867c-a367606f89f9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:03.956584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:04.022593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76b0be-3dbb-4762-958a-6edb560d46d1 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.065201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72d53-2157-4db7-80dd-d46be324410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.066129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72d53-2157-4db7-80dd-d46be324410e None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.066623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72d53-2157-4db7-80dd-d46be324410e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.067109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72d53-2157-4db7-80dd-d46be324410e None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.067929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb72d53-2157-4db7-80dd-d46be324410e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:04.069511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb72d53-2157-4db7-80dd-d46be324410e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:04.078392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053b83-c286-4b00-867c-a367606f89f9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.087625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 376/738] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:03 2022] POST /identity/v3/services => generated 240 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:04.089250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72d53-2157-4db7-80dd-d46be324410e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.137879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429f0bc-905b-49d4-aa9e-f7e628cd484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.140178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429f0bc-905b-49d4-aa9e-f7e628cd484b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.140673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429f0bc-905b-49d4-aa9e-f7e628cd484b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.141130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429f0bc-905b-49d4-aa9e-f7e628cd484b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.148113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:04.161410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429f0bc-905b-49d4-aa9e-f7e628cd484b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-a429f0bc-905b-49d4-aa9e-f7e628cd484b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:04.169977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:04.171026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:04.171934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:04.173222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 363/739] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:04.178963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429f0bc-905b-49d4-aa9e-f7e628cd484b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.237435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72d53-2157-4db7-80dd-d46be324410e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.258845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:04.294608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb489d9-7e1e-4e8e-b4d1-07c4a4f5f9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.295156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429f0bc-905b-49d4-aa9e-f7e628cd484b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.296173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb489d9-7e1e-4e8e-b4d1-07c4a4f5f9b8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.296648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb489d9-7e1e-4e8e-b4d1-07c4a4f5f9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.297340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb489d9-7e1e-4e8e-b4d1-07c4a4f5f9b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.311865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb489d9-7e1e-4e8e-b4d1-07c4a4f5f9b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:04.314354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb489d9-7e1e-4e8e-b4d1-07c4a4f5f9b8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4cb489d9-7e1e-4e8e-b4d1-07c4a4f5f9b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:04.336118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:04.337160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:04.338061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:04.338061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:04.338061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:04.338061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 377/740] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:04.338844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb489d9-7e1e-4e8e-b4d1-07c4a4f5f9b8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.339688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e89c26-9b3d-47f2-8f33-dfd0b70ca1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.340559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e89c26-9b3d-47f2-8f33-dfd0b70ca1bd None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.341099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e89c26-9b3d-47f2-8f33-dfd0b70ca1bd None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.341779 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e89c26-9b3d-47f2-8f33-dfd0b70ca1bd None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.343478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e89c26-9b3d-47f2-8f33-dfd0b70ca1bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:04.343478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e89c26-9b3d-47f2-8f33-dfd0b70ca1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:04.346837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e89c26-9b3d-47f2-8f33-dfd0b70ca1bd None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:04.354624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 364/741] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:04.356245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e89c26-9b3d-47f2-8f33-dfd0b70ca1bd None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.464171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e89c26-9b3d-47f2-8f33-dfd0b70ca1bd None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.464788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:04.476755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb489d9-7e1e-4e8e-b4d1-07c4a4f5f9b8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.507288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:04.510795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ce4d9-082b-46cc-b560-743f49da351b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.511626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ce4d9-082b-46cc-b560-743f49da351b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.512277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ce4d9-082b-46cc-b560-743f49da351b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.512727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ce4d9-082b-46cc-b560-743f49da351b None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.514200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ce4d9-082b-46cc-b560-743f49da351b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:04.514669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ce4d9-082b-46cc-b560-743f49da351b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:04.516692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ce4d9-082b-46cc-b560-743f49da351b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:04.518176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023dd26-82f1-4f38-a029-7fae25c1e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.518944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023dd26-82f1-4f38-a029-7fae25c1e4ff None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.519378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023dd26-82f1-4f38-a029-7fae25c1e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.520428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023dd26-82f1-4f38-a029-7fae25c1e4ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.531624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023dd26-82f1-4f38-a029-7fae25c1e4ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:04.537909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 365/742] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-8023dd26-82f1-4f38-a029-7fae25c1e4ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:04.538601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:04.539775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:35:04.540884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:04.542258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ce4d9-082b-46cc-b560-743f49da351b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.542885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 378/743] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:04.543748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023dd26-82f1-4f38-a029-7fae25c1e4ff None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.687055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ce4d9-082b-46cc-b560-743f49da351b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.687717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023dd26-82f1-4f38-a029-7fae25c1e4ff None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.726720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd71c1a-3702-487e-bfef-1e5a9ecb4833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.727397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd71c1a-3702-487e-bfef-1e5a9ecb4833 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.727674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd71c1a-3702-487e-bfef-1e5a9ecb4833 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.727943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd71c1a-3702-487e-bfef-1e5a9ecb4833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.737829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2008526-1c5f-42cf-a81e-1e4808becdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.740279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008526-1c5f-42cf-a81e-1e4808becdea None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.740770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008526-1c5f-42cf-a81e-1e4808becdea None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.741480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008526-1c5f-42cf-a81e-1e4808becdea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.742086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd71c1a-3702-487e-bfef-1e5a9ecb4833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:04.743678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd71c1a-3702-487e-bfef-1e5a9ecb4833 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:04.750106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008526-1c5f-42cf-a81e-1e4808becdea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:04.753129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008526-1c5f-42cf-a81e-1e4808becdea None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-0cd71c1a-3702-487e-bfef-1e5a9ecb4833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:04.759528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:04.760515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:04.761448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:04.761448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:04.761448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:04.765560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 366/744] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:04.766553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd71c1a-3702-487e-bfef-1e5a9ecb4833 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-a2008526-1c5f-42cf-a81e-1e4808becdea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:04.769801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:04.770914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:04.771848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:04.771848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:04.771848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:04.771848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:04.771848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:04.771848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:04.771848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:04.771848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:04.775103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 379/745] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:04.776161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2008526-1c5f-42cf-a81e-1e4808becdea None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.796674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:04.824878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:04.889486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd71c1a-3702-487e-bfef-1e5a9ecb4833 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.893393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2008526-1c5f-42cf-a81e-1e4808becdea None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.931033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6d2f-1bba-4c03-978c-798627ed82ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.931244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b6bfd-3ecc-4fc8-b120-939163474aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.931883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6bfd-3ecc-4fc8-b120-939163474aee None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.932227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6bfd-3ecc-4fc8-b120-939163474aee None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.932514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6d2f-1bba-4c03-978c-798627ed82ae None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.932618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6bfd-3ecc-4fc8-b120-939163474aee None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.933048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6d2f-1bba-4c03-978c-798627ed82ae None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.933341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b6bfd-3ecc-4fc8-b120-939163474aee None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:04.933682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6d2f-1bba-4c03-978c-798627ed82ae None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.933783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b6bfd-3ecc-4fc8-b120-939163474aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:04.934579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c6d2f-1bba-4c03-978c-798627ed82ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:04.935082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c6d2f-1bba-4c03-978c-798627ed82ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:04.935246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b6bfd-3ecc-4fc8-b120-939163474aee None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:04.936762 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c6d2f-1bba-4c03-978c-798627ed82ae None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:04.948866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 367/746] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:04.949969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b6bfd-3ecc-4fc8-b120-939163474aee None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.950172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 380/747] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:04.958198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6d2f-1bba-4c03-978c-798627ed82ae None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.046227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.063915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b6bfd-3ecc-4fc8-b120-939163474aee None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.071950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.084022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6d2f-1bba-4c03-978c-798627ed82ae None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.102666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2d87b-dcd3-431f-92d3-342eb01211a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.103820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d87b-dcd3-431f-92d3-342eb01211a4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.104296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d87b-dcd3-431f-92d3-342eb01211a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.104758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d87b-dcd3-431f-92d3-342eb01211a4 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.105732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2d87b-dcd3-431f-92d3-342eb01211a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:05.106239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2d87b-dcd3-431f-92d3-342eb01211a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.107908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2d87b-dcd3-431f-92d3-342eb01211a4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.125344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 368/748] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:05.125344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2d87b-dcd3-431f-92d3-342eb01211a4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.127829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872b312-8bb3-4fd8-91f0-981dcef95f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.128329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872b312-8bb3-4fd8-91f0-981dcef95f6d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.128659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872b312-8bb3-4fd8-91f0-981dcef95f6d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.128986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872b312-8bb3-4fd8-91f0-981dcef95f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.143540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872b312-8bb3-4fd8-91f0-981dcef95f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.146641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872b312-8bb3-4fd8-91f0-981dcef95f6d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-1872b312-8bb3-4fd8-91f0-981dcef95f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:05.167735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:05.168710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:05.169606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:05.169606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:05.169606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:05.172181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 381/749] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:05.173267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872b312-8bb3-4fd8-91f0-981dcef95f6d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.250162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2d87b-dcd3-431f-92d3-342eb01211a4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.288238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d11d56-d9b5-4618-99bc-dc8dbea72576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.288878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d11d56-d9b5-4618-99bc-dc8dbea72576 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.289159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d11d56-d9b5-4618-99bc-dc8dbea72576 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.289432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d11d56-d9b5-4618-99bc-dc8dbea72576 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.297946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d11d56-d9b5-4618-99bc-dc8dbea72576 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.299274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d11d56-d9b5-4618-99bc-dc8dbea72576 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-94d11d56-d9b5-4618-99bc-dc8dbea72576 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:05.311707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:05.312687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 369/750] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:05.314349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d11d56-d9b5-4618-99bc-dc8dbea72576 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.315733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872b312-8bb3-4fd8-91f0-981dcef95f6d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.345157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.354514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.369562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d100d-4807-4d3d-90b9-191549011575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.370672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d100d-4807-4d3d-90b9-191549011575 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.371587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d100d-4807-4d3d-90b9-191549011575 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.372338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d100d-4807-4d3d-90b9-191549011575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.373270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d100d-4807-4d3d-90b9-191549011575 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=7345509ac3604cf99c0e9ef232afcd09) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:05.373947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d100d-4807-4d3d-90b9-191549011575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.375919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d100d-4807-4d3d-90b9-191549011575 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.384769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 382/751] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/role_assignments?user.id=7345509ac3604cf99c0e9ef232afcd09&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:05.385914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d100d-4807-4d3d-90b9-191549011575 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.482131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d11d56-d9b5-4618-99bc-dc8dbea72576 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.513117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d100d-4807-4d3d-90b9-191549011575 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.553704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6175e-1f5c-4d52-a41b-00cab0fbac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.554690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6175e-1f5c-4d52-a41b-00cab0fbac07 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.555607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6175e-1f5c-4d52-a41b-00cab0fbac07 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.556073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6175e-1f5c-4d52-a41b-00cab0fbac07 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.557016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6175e-1f5c-4d52-a41b-00cab0fbac07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:05.557594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6175e-1f5c-4d52-a41b-00cab0fbac07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.561870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6175e-1f5c-4d52-a41b-00cab0fbac07 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.584403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 383/752] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:05.591123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6175e-1f5c-4d52-a41b-00cab0fbac07 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.599470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46054a2a-464d-4917-80ec-f0f2f22db4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.600105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46054a2a-464d-4917-80ec-f0f2f22db4b6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.600381 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46054a2a-464d-4917-80ec-f0f2f22db4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.600653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46054a2a-464d-4917-80ec-f0f2f22db4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.602401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46054a2a-464d-4917-80ec-f0f2f22db4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:05.603071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46054a2a-464d-4917-80ec-f0f2f22db4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.604817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46054a2a-464d-4917-80ec-f0f2f22db4b6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.651133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.714840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6175e-1f5c-4d52-a41b-00cab0fbac07 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.754827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4924e-4a5e-47af-bd27-65ac33b367b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.754827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4924e-4a5e-47af-bd27-65ac33b367b5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.754827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4924e-4a5e-47af-bd27-65ac33b367b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.754827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4924e-4a5e-47af-bd27-65ac33b367b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.766679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4924e-4a5e-47af-bd27-65ac33b367b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.767067 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4924e-4a5e-47af-bd27-65ac33b367b5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.791785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 370/753] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-18b4924e-4a5e-47af-bd27-65ac33b367b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:05.793716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:05.794658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:05.795623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:05.795623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:05.795623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:05.795623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 384/754] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:05.797361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46054a2a-464d-4917-80ec-f0f2f22db4b6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.802712 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4924e-4a5e-47af-bd27-65ac33b367b5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.911304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.917747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.922428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4924e-4a5e-47af-bd27-65ac33b367b5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.926261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46054a2a-464d-4917-80ec-f0f2f22db4b6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.958507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534d7e5-7924-46c2-b942-3de4fd56157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.958979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534d7e5-7924-46c2-b942-3de4fd56157d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.959384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534d7e5-7924-46c2-b942-3de4fd56157d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.959656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534d7e5-7924-46c2-b942-3de4fd56157d None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.960301 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534d7e5-7924-46c2-b942-3de4fd56157d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:05.960633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534d7e5-7924-46c2-b942-3de4fd56157d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.962190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534d7e5-7924-46c2-b942-3de4fd56157d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.965048 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd2f5c-e094-4319-8500-24f642d99f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.965950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd2f5c-e094-4319-8500-24f642d99f18 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.966422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd2f5c-e094-4319-8500-24f642d99f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.966924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd2f5c-e094-4319-8500-24f642d99f18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.975129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd2f5c-e094-4319-8500-24f642d99f18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.975943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 385/755] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:05.977277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd2f5c-e094-4319-8500-24f642d99f18 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.977387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf265492-f611-4865-9ab6-19516e03da0f None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.977569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf265492-f611-4865-9ab6-19516e03da0f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.977847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf265492-f611-4865-9ab6-19516e03da0f None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.979124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 386/756] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:05.983974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf265492-f611-4865-9ab6-19516e03da0f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-69fd2f5c-e094-4319-8500-24f642d99f18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:05.991756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:05.992818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:05.993760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:05.996389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 371/757] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:05.997872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c0b85-dd55-4eae-8975-60c5b03bfe8d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.998348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c0b85-dd55-4eae-8975-60c5b03bfe8d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.998903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c0b85-dd55-4eae-8975-60c5b03bfe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.018661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8c3c0b85-dd55-4eae-8975-60c5b03bfe8d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:06.020330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8c3c0b85-dd55-4eae-8975-60c5b03bfe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:06.098893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf265492-f611-4865-9ab6-19516e03da0f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:06.103284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 372/758] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:06.104455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c0b85-dd55-4eae-8975-60c5b03bfe8d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:06.151722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeb4eb-9f7a-4f7f-854f-b3c84cc44126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:06.152390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeb4eb-9f7a-4f7f-854f-b3c84cc44126 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.152666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeb4eb-9f7a-4f7f-854f-b3c84cc44126 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.152933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeb4eb-9f7a-4f7f-854f-b3c84cc44126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.160513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeb4eb-9f7a-4f7f-854f-b3c84cc44126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:06.162460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeb4eb-9f7a-4f7f-854f-b3c84cc44126 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4eeeb4eb-9f7a-4f7f-854f-b3c84cc44126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:06.178939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:06.179925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:06.180829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:06.180829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:06.180829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:06.180829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:06.180829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:06.180829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:06.180829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:06.180829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:06.181283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 387/759] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:06.185643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeb4eb-9f7a-4f7f-854f-b3c84cc44126 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:06.191184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:06.216318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c0b85-dd55-4eae-8975-60c5b03bfe8d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:06.220038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:06.260400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224730b-27ab-42c5-9257-2cd2b6920c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:06.261701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224730b-27ab-42c5-9257-2cd2b6920c77 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.262201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224730b-27ab-42c5-9257-2cd2b6920c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.262739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224730b-27ab-42c5-9257-2cd2b6920c77 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.263689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224730b-27ab-42c5-9257-2cd2b6920c77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:06.264187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224730b-27ab-42c5-9257-2cd2b6920c77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:06.265819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224730b-27ab-42c5-9257-2cd2b6920c77 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:06.298611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 373/760] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Aug 18 20:35:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:06.304893 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224730b-27ab-42c5-9257-2cd2b6920c77 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:06.393861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeb4eb-9f7a-4f7f-854f-b3c84cc44126 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:06.442045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c5571-f0a2-4091-90a8-d77819e9031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:06.443401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c5571-f0a2-4091-90a8-d77819e9031d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.443747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c5571-f0a2-4091-90a8-d77819e9031d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.443949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c5571-f0a2-4091-90a8-d77819e9031d None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.444629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c5571-f0a2-4091-90a8-d77819e9031d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:06.444941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c5571-f0a2-4091-90a8-d77819e9031d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:06.446407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c5571-f0a2-4091-90a8-d77819e9031d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:06.456274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224730b-27ab-42c5-9257-2cd2b6920c77 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:06.459840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 388/761] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:06.465577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f20722-160e-44cb-867b-58a709ca6f33 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.465865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f20722-160e-44cb-867b-58a709ca6f33 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.466146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f20722-160e-44cb-867b-58a709ca6f33 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.467430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 389/762] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:06.468129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f20722-160e-44cb-867b-58a709ca6f33 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:06.503173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a4899-0c2d-43a2-97f3-c3aca32d4e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:06.503881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a4899-0c2d-43a2-97f3-c3aca32d4e45 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.505221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a4899-0c2d-43a2-97f3-c3aca32d4e45 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.505502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a4899-0c2d-43a2-97f3-c3aca32d4e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.508555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:06.560961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:06.586563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f20722-160e-44cb-867b-58a709ca6f33 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:06.592786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a4899-0c2d-43a2-97f3-c3aca32d4e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:06.592786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a4899-0c2d-43a2-97f3-c3aca32d4e45 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:06.626479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d606790-9017-40ba-adec-8291e6db72ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:06.627414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d606790-9017-40ba-adec-8291e6db72ce None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.627696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d606790-9017-40ba-adec-8291e6db72ce None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.627970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d606790-9017-40ba-adec-8291e6db72ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.628556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d606790-9017-40ba-adec-8291e6db72ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:06.631139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d606790-9017-40ba-adec-8291e6db72ce None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4d606790-9017-40ba-adec-8291e6db72ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:06.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:06.643233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:06.644097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 390/763] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Aug 18 20:35:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:06.644986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d606790-9017-40ba-adec-8291e6db72ce None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:06.711153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 374/764] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:06.712323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6db674-351c-42d6-a404-e997b18b9ba1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.712535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6db674-351c-42d6-a404-e997b18b9ba1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.712805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6db674-351c-42d6-a404-e997b18b9ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.732528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ee6db674-351c-42d6-a404-e997b18b9ba1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:06.733789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ee6db674-351c-42d6-a404-e997b18b9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:06.762400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d606790-9017-40ba-adec-8291e6db72ce None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:06.763572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:06.797104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc2f54-31ef-43a9-8d7a-983d350424f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:06.797900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc2f54-31ef-43a9-8d7a-983d350424f2 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.798274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc2f54-31ef-43a9-8d7a-983d350424f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.798647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc2f54-31ef-43a9-8d7a-983d350424f2 None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/d6e704b8291b4934a20cdde2ef127493/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.801258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc2f54-31ef-43a9-8d7a-983d350424f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=d6e704b8291b4934a20cdde2ef127493, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:06.802960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc2f54-31ef-43a9-8d7a-983d350424f2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:06.810750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 375/765] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:06.811879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6db674-351c-42d6-a404-e997b18b9ba1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:06.834804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 391/766] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:06 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/d6e704b8291b4934a20cdde2ef127493/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:35:06.834804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc2f54-31ef-43a9-8d7a-983d350424f2 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:06.839498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.014232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6db674-351c-42d6-a404-e997b18b9ba1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.025311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc2f54-31ef-43a9-8d7a-983d350424f2 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.056883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c9eeb-4707-4d13-9f1b-0cf6c58649a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.057606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9eeb-4707-4d13-9f1b-0cf6c58649a1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.057952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9eeb-4707-4d13-9f1b-0cf6c58649a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.058409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9eeb-4707-4d13-9f1b-0cf6c58649a1 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.059157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c9eeb-4707-4d13-9f1b-0cf6c58649a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:07.059524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c9eeb-4707-4d13-9f1b-0cf6c58649a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.061087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c9eeb-4707-4d13-9f1b-0cf6c58649a1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.066824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 376/767] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Aug 18 20:35:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:07.072335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c9eeb-4707-4d13-9f1b-0cf6c58649a1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.076251 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b89fc-464b-4660-a939-ef302d4d818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.077522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b89fc-464b-4660-a939-ef302d4d818c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.079042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b89fc-464b-4660-a939-ef302d4d818c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.079533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b89fc-464b-4660-a939-ef302d4d818c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.094035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b89fc-464b-4660-a939-ef302d4d818c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.096567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b89fc-464b-4660-a939-ef302d4d818c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.108246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4e6b89fc-464b-4660-a939-ef302d4d818c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:07.120145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:07.121266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:07.122182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:07.122182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:07.122182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:07.124063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 392/768] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:07.129684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b89fc-464b-4660-a939-ef302d4d818c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.197336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c9eeb-4707-4d13-9f1b-0cf6c58649a1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.202254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.241873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee95a1c-9373-4fa6-b469-ea0028efcdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.242709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee95a1c-9373-4fa6-b469-ea0028efcdcf None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.243117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee95a1c-9373-4fa6-b469-ea0028efcdcf None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.243485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee95a1c-9373-4fa6-b469-ea0028efcdcf None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.244245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee95a1c-9373-4fa6-b469-ea0028efcdcf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:07.244646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee95a1c-9373-4fa6-b469-ea0028efcdcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.246118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee95a1c-9373-4fa6-b469-ea0028efcdcf None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.256075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 377/769] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:07.256075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee95a1c-9373-4fa6-b469-ea0028efcdcf None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.265532 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b89fc-464b-4660-a939-ef302d4d818c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.314845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5100a6-4289-471d-a598-fd6035955eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.315933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5100a6-4289-471d-a598-fd6035955eae None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.316479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5100a6-4289-471d-a598-fd6035955eae None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.317519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5100a6-4289-471d-a598-fd6035955eae None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.318661 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5100a6-4289-471d-a598-fd6035955eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:07.319255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5100a6-4289-471d-a598-fd6035955eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.321952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5100a6-4289-471d-a598-fd6035955eae None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.339840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 393/770] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:07.341095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5100a6-4289-471d-a598-fd6035955eae None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.365315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.375527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee95a1c-9373-4fa6-b469-ea0028efcdcf None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.417815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ec59b-2408-4c27-a416-1337003957e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.418488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ec59b-2408-4c27-a416-1337003957e1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.418778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ec59b-2408-4c27-a416-1337003957e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.419057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ec59b-2408-4c27-a416-1337003957e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.419652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ec59b-2408-4c27-a416-1337003957e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.421238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ec59b-2408-4c27-a416-1337003957e1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-d40ec59b-2408-4c27-a416-1337003957e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:07.431750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:07.432822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:07.433666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 378/771] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:07.434500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ec59b-2408-4c27-a416-1337003957e1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.482403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5100a6-4289-471d-a598-fd6035955eae None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.515132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.524475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d96f6-a08f-438d-bca9-745df9471f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.525238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d96f6-a08f-438d-bca9-745df9471f7e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.526025 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d96f6-a08f-438d-bca9-745df9471f7e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.526476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d96f6-a08f-438d-bca9-745df9471f7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.527452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d96f6-a08f-438d-bca9-745df9471f7e None admin] RBAC: Adding query filter params (interface=public, service_id=338b241e8db2457089fc1dc6e77d1939, region_id=RegionOne) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:07.527938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d96f6-a08f-438d-bca9-745df9471f7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.529555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d96f6-a08f-438d-bca9-745df9471f7e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.543028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ec59b-2408-4c27-a416-1337003957e1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.543518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 394/772] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/endpoints?service_id=338b241e8db2457089fc1dc6e77d1939&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:07.544692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d96f6-a08f-438d-bca9-745df9471f7e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.583411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b985-a789-467d-b649-b68a300c42f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.584800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b985-a789-467d-b649-b68a300c42f2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.584800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b985-a789-467d-b649-b68a300c42f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.584800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b985-a789-467d-b649-b68a300c42f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.597310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182b985-a789-467d-b649-b68a300c42f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.599208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182b985-a789-467d-b649-b68a300c42f2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2182b985-a789-467d-b649-b68a300c42f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:07.611073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:07.612035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:07.612951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:07.612951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:07.612951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:07.612951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:07.612951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:07.612951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:07.612951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:07.612951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:07.617696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 379/773] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:07.618657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b985-a789-467d-b649-b68a300c42f2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.638358 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.664225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d96f6-a08f-438d-bca9-745df9471f7e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.701487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001a244-f6ae-484f-ab3e-cdb185c2fabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.702377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001a244-f6ae-484f-ab3e-cdb185c2fabc None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.702856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001a244-f6ae-484f-ab3e-cdb185c2fabc None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.703320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001a244-f6ae-484f-ab3e-cdb185c2fabc None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.704202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001a244-f6ae-484f-ab3e-cdb185c2fabc None admin] RBAC: Adding query filter params (name=network) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:07.704649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001a244-f6ae-484f-ab3e-cdb185c2fabc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.706288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001a244-f6ae-484f-ab3e-cdb185c2fabc None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.711287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 395/774] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:07.712290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001a244-f6ae-484f-ab3e-cdb185c2fabc None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.732036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b985-a789-467d-b649-b68a300c42f2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.770371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.772658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f82a19-1170-45cf-a626-9c86ea2d94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.773406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f82a19-1170-45cf-a626-9c86ea2d94fa None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.773811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f82a19-1170-45cf-a626-9c86ea2d94fa None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.774157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f82a19-1170-45cf-a626-9c86ea2d94fa None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.774997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f82a19-1170-45cf-a626-9c86ea2d94fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.776356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f82a19-1170-45cf-a626-9c86ea2d94fa None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.781858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 380/775] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:07.783183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b459b2-7b88-4dbd-9568-c64306a0887e None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.783474 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b459b2-7b88-4dbd-9568-c64306a0887e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.783751 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b459b2-7b88-4dbd-9568-c64306a0887e None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.785716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 381/776] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:07.791144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b459b2-7b88-4dbd-9568-c64306a0887e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.866907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001a244-f6ae-484f-ab3e-cdb185c2fabc None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.899156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.912239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce082e-5acb-43e2-82ac-d31aaa96980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.914116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce082e-5acb-43e2-82ac-d31aaa96980d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.914619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce082e-5acb-43e2-82ac-d31aaa96980d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.915370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce082e-5acb-43e2-82ac-d31aaa96980d None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.916556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce082e-5acb-43e2-82ac-d31aaa96980d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:07.917060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce082e-5acb-43e2-82ac-d31aaa96980d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.919669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce082e-5acb-43e2-82ac-d31aaa96980d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.927782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b459b2-7b88-4dbd-9568-c64306a0887e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.938210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 396/777] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:07.940174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3d2fb-4c07-4a7d-88b4-129379b853c8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.940977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3d2fb-4c07-4a7d-88b4-129379b853c8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.941504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3d2fb-4c07-4a7d-88b4-129379b853c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.969511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-62b3d2fb-4c07-4a7d-88b4-129379b853c8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:07.970699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6288-8fad-4ae9-bd46-d5d32ce9c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.970974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-62b3d2fb-4c07-4a7d-88b4-129379b853c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:07.971390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6288-8fad-4ae9-bd46-d5d32ce9c05a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.971673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6288-8fad-4ae9-bd46-d5d32ce9c05a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.971951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6288-8fad-4ae9-bd46-d5d32ce9c05a None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.973600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e6288-8fad-4ae9-bd46-d5d32ce9c05a None admin] RBAC: Adding query filter params (type=network) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:07.974172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e6288-8fad-4ae9-bd46-d5d32ce9c05a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.975622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e6288-8fad-4ae9-bd46-d5d32ce9c05a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.983976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 382/778] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:07.984326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6288-8fad-4ae9-bd46-d5d32ce9c05a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:08.051314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 397/779] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:08.052292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3d2fb-4c07-4a7d-88b4-129379b853c8 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:08.109214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:08.149879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6288-8fad-4ae9-bd46-d5d32ce9c05a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:08.211395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42293797-2f0a-420a-a5ed-f3d840ebf7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:08.212875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42293797-2f0a-420a-a5ed-f3d840ebf7a3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.212875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42293797-2f0a-420a-a5ed-f3d840ebf7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.212875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42293797-2f0a-420a-a5ed-f3d840ebf7a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.213324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42293797-2f0a-420a-a5ed-f3d840ebf7a3 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=18429472ab6b403ea10105bf9239ce21) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:08.213619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42293797-2f0a-420a-a5ed-f3d840ebf7a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:08.217389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42293797-2f0a-420a-a5ed-f3d840ebf7a3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:08.226003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 383/780] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:07 2022] GET /identity/v3/role_assignments?user.id=18429472ab6b403ea10105bf9239ce21&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:08.232084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3d2fb-4c07-4a7d-88b4-129379b853c8 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:08.292420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64adab9-7734-4797-96dd-73f7ecea7f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:08.293050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64adab9-7734-4797-96dd-73f7ecea7f8f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.293325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64adab9-7734-4797-96dd-73f7ecea7f8f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.293591 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64adab9-7734-4797-96dd-73f7ecea7f8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.294364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64adab9-7734-4797-96dd-73f7ecea7f8f None admin] RBAC: Adding query filter params (interface=public, service_id=47e33982095c47e69da9fab34ab52472, region_id=RegionOne) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:08.294675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64adab9-7734-4797-96dd-73f7ecea7f8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:08.296128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64adab9-7734-4797-96dd-73f7ecea7f8f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:08.307930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 398/781] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Aug 18 20:35:08 2022] GET /identity/v3/endpoints?service_id=47e33982095c47e69da9fab34ab52472&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:08.313372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42293797-2f0a-420a-a5ed-f3d840ebf7a3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:08.337267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:08.361134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64adab9-7734-4797-96dd-73f7ecea7f8f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:08.452076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42293797-2f0a-420a-a5ed-f3d840ebf7a3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:08.486115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:08.493339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bc388-c84c-4e03-943f-e2e1ba4cf769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:08.493955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bc388-c84c-4e03-943f-e2e1ba4cf769 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.494232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bc388-c84c-4e03-943f-e2e1ba4cf769 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.494500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bc388-c84c-4e03-943f-e2e1ba4cf769 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.495135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bc388-c84c-4e03-943f-e2e1ba4cf769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:08.495898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64adab9-7734-4797-96dd-73f7ecea7f8f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:08.496516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bc388-c84c-4e03-943f-e2e1ba4cf769 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:08.507166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 384/782] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:08 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:08.539013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37a2a2-1e2a-44ce-a340-e59389ce01a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:08.540101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37a2a2-1e2a-44ce-a340-e59389ce01a5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.540587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37a2a2-1e2a-44ce-a340-e59389ce01a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.541061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37a2a2-1e2a-44ce-a340-e59389ce01a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.554126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37a2a2-1e2a-44ce-a340-e59389ce01a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-0c37a2a2-1e2a-44ce-a340-e59389ce01a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:08.559434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:08.560388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:08.561256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:08.564148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 399/783] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:08.570746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bc388-c84c-4e03-943f-e2e1ba4cf769 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:08.682900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:08.731460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bc388-c84c-4e03-943f-e2e1ba4cf769 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:08.778384 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383740ae-c51f-4a87-bfe5-4b2fa6d077fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:08.779023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383740ae-c51f-4a87-bfe5-4b2fa6d077fd None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.779299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383740ae-c51f-4a87-bfe5-4b2fa6d077fd None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.779569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383740ae-c51f-4a87-bfe5-4b2fa6d077fd None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.780239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383740ae-c51f-4a87-bfe5-4b2fa6d077fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:08.780536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383740ae-c51f-4a87-bfe5-4b2fa6d077fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:08.781924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383740ae-c51f-4a87-bfe5-4b2fa6d077fd None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:08.790920 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 385/784] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:08.796412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37a2a2-1e2a-44ce-a340-e59389ce01a5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.040426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d52b-4029-473b-afa8-0fd2c5966770 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.040832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d52b-4029-473b-afa8-0fd2c5966770 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.041017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d52b-4029-473b-afa8-0fd2c5966770 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.042437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 386/785] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:09.047943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22864e7a-b9b4-4ab7-9cc0-c2a17c4c3dd4 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.048535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22864e7a-b9b4-4ab7-9cc0-c2a17c4c3dd4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.049112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22864e7a-b9b4-4ab7-9cc0-c2a17c4c3dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.061605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37a2a2-1e2a-44ce-a340-e59389ce01a5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.069365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-22864e7a-b9b4-4ab7-9cc0-c2a17c4c3dd4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:09.070921 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-22864e7a-b9b4-4ab7-9cc0-c2a17c4c3dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:09.120110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066504b1-460a-48aa-ab99-eee4881803a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.120763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066504b1-460a-48aa-ab99-eee4881803a4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.121041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066504b1-460a-48aa-ab99-eee4881803a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.121312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066504b1-460a-48aa-ab99-eee4881803a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.146268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066504b1-460a-48aa-ab99-eee4881803a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:09.147839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066504b1-460a-48aa-ab99-eee4881803a4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:09.159298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 387/786] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-066504b1-460a-48aa-ab99-eee4881803a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:09.183748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:09.184784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:09.186292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:09.186292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:09.186292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:09.186292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 400/787] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:09.190565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22864e7a-b9b4-4ab7-9cc0-c2a17c4c3dd4 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.278737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:09.319073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22864e7a-b9b4-4ab7-9cc0-c2a17c4c3dd4 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.355458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8621-1806-4f26-9cb0-576cd1177db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.356074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8621-1806-4f26-9cb0-576cd1177db1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.356357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8621-1806-4f26-9cb0-576cd1177db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.356632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8621-1806-4f26-9cb0-576cd1177db1 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.357283 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8621-1806-4f26-9cb0-576cd1177db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:09.357585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8621-1806-4f26-9cb0-576cd1177db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:09.359003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8621-1806-4f26-9cb0-576cd1177db1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:09.371733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 388/788] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:09.376800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066504b1-460a-48aa-ab99-eee4881803a4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.401511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:09.527325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066504b1-460a-48aa-ab99-eee4881803a4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.565912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8621-1806-4f26-9cb0-576cd1177db1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.580075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7f5a5-f0b5-43fe-8fd1-a4602e04806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.581046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7f5a5-f0b5-43fe-8fd1-a4602e04806e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.581527 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7f5a5-f0b5-43fe-8fd1-a4602e04806e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.582749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7f5a5-f0b5-43fe-8fd1-a4602e04806e None admin] PATH_INFO: `/v3/users/swift` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.594118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7f5a5-f0b5-43fe-8fd1-a4602e04806e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:09.596297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7f5a5-f0b5-43fe-8fd1-a4602e04806e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-e7f7f5a5-f0b5-43fe-8fd1-a4602e04806e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:09.612472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:09.614237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:35:09.615508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:09.624259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 401/789] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:09.630145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7f5a5-f0b5-43fe-8fd1-a4602e04806e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.732450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8621-1806-4f26-9cb0-576cd1177db1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.765307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:09.791132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:09.792596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4e051-dd3f-4ad9-8a62-20f46ea5fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.793272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4e051-dd3f-4ad9-8a62-20f46ea5fd59 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.793554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4e051-dd3f-4ad9-8a62-20f46ea5fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.793828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4e051-dd3f-4ad9-8a62-20f46ea5fd59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.826479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4e051-dd3f-4ad9-8a62-20f46ea5fd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-24f4e051-dd3f-4ad9-8a62-20f46ea5fd59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:09.837081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:09.838847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:09.840343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:09.842316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 389/790] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:09.844446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4e051-dd3f-4ad9-8a62-20f46ea5fd59 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.868718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7f5a5-f0b5-43fe-8fd1-a4602e04806e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.913167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfa4c2-f674-4bd1-ab3e-264f8a921854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.913794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfa4c2-f674-4bd1-ab3e-264f8a921854 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.914074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfa4c2-f674-4bd1-ab3e-264f8a921854 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.914349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfa4c2-f674-4bd1-ab3e-264f8a921854 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.915115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfa4c2-f674-4bd1-ab3e-264f8a921854 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:09.915420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfa4c2-f674-4bd1-ab3e-264f8a921854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:09.917462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfa4c2-f674-4bd1-ab3e-264f8a921854 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:09.938383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 402/791] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:09.943819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfa4c2-f674-4bd1-ab3e-264f8a921854 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.073794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4e051-dd3f-4ad9-8a62-20f46ea5fd59 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.116813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfa4c2-f674-4bd1-ab3e-264f8a921854 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.146914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.156908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af2246-a7b8-4db3-aced-7669e927a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.157550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af2246-a7b8-4db3-aced-7669e927a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.157828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af2246-a7b8-4db3-aced-7669e927a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.158097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af2246-a7b8-4db3-aced-7669e927a5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.170355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af2246-a7b8-4db3-aced-7669e927a5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.172151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af2246-a7b8-4db3-aced-7669e927a5b5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.184040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3f48-d3f1-4eb1-92ff-24d2488475c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.184660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3f48-d3f1-4eb1-92ff-24d2488475c5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.184937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3f48-d3f1-4eb1-92ff-24d2488475c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.185221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3f48-d3f1-4eb1-92ff-24d2488475c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.185872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3f48-d3f1-4eb1-92ff-24d2488475c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:10.186216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3f48-d3f1-4eb1-92ff-24d2488475c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.187709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3f48-d3f1-4eb1-92ff-24d2488475c5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-84af2246-a7b8-4db3-aced-7669e927a5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:10.188028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:10.189519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:10.191809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:10.191809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:10.191809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:10.191809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 403/792] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:10.195052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af2246-a7b8-4db3-aced-7669e927a5b5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.205025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 390/793] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:10.211780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3f48-d3f1-4eb1-92ff-24d2488475c5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.265773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.333735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3f48-d3f1-4eb1-92ff-24d2488475c5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.337806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af2246-a7b8-4db3-aced-7669e927a5b5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.371108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30a0e-8f03-4622-ae19-b42b315e8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.372152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30a0e-8f03-4622-ae19-b42b315e8366 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.372629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30a0e-8f03-4622-ae19-b42b315e8366 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.373111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30a0e-8f03-4622-ae19-b42b315e8366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.385417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30a0e-8f03-4622-ae19-b42b315e8366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.386377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8de29-2b49-4008-81d2-d909ccc9dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.387021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8de29-2b49-4008-81d2-d909ccc9dfbe None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.387313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8de29-2b49-4008-81d2-d909ccc9dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.387569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8de29-2b49-4008-81d2-d909ccc9dfbe None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.388117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30a0e-8f03-4622-ae19-b42b315e8366 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.388222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8de29-2b49-4008-81d2-d909ccc9dfbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:10.388512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8de29-2b49-4008-81d2-d909ccc9dfbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.390032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8de29-2b49-4008-81d2-d909ccc9dfbe None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-bbb30a0e-8f03-4622-ae19-b42b315e8366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:10.403999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:10.404967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:10.405888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:10.405888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:10.405888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:10.406058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 404/794] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:10.406571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8571615-f466-43ff-8865-6c9279601411 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.406823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8571615-f466-43ff-8865-6c9279601411 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.407102 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8571615-f466-43ff-8865-6c9279601411 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.412385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 405/795] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:10.412385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8571615-f466-43ff-8865-6c9279601411 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.412989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 391/796] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:10.414547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e97d-f813-4972-a348-cb2ed2f3ea47 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.415060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e97d-f813-4972-a348-cb2ed2f3ea47 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.415543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e97d-f813-4972-a348-cb2ed2f3ea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.435315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1d73e97d-f813-4972-a348-cb2ed2f3ea47 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:10.436839 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1d73e97d-f813-4972-a348-cb2ed2f3ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:10.473927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.514812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 392/797] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:10.514812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73e97d-f813-4972-a348-cb2ed2f3ea47 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.551819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.580904 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8571615-f466-43ff-8865-6c9279601411 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.645524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d0d13-62b1-430d-956a-833ad678bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.646257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d0d13-62b1-430d-956a-833ad678bc9f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.646673 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d0d13-62b1-430d-956a-833ad678bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.647061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d0d13-62b1-430d-956a-833ad678bc9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.662020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d0d13-62b1-430d-956a-833ad678bc9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.663660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d0d13-62b1-430d-956a-833ad678bc9f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.671611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73e97d-f813-4972-a348-cb2ed2f3ea47 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-f37d0d13-62b1-430d-956a-833ad678bc9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:10.697462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:10.698590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 406/798] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656b7e-2af0-4330-9961-8fcb507fe82b None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.700422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656b7e-2af0-4330-9961-8fcb507fe82b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.701825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656b7e-2af0-4330-9961-8fcb507fe82b None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.706760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 407/799] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:10.708255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656b7e-2af0-4330-9961-8fcb507fe82b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.713388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0d508-52fa-4d30-9d7b-e58a988214e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.714045 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0d508-52fa-4d30-9d7b-e58a988214e1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.714325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0d508-52fa-4d30-9d7b-e58a988214e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.714601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0d508-52fa-4d30-9d7b-e58a988214e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.715271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0d508-52fa-4d30-9d7b-e58a988214e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:10.715570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0d508-52fa-4d30-9d7b-e58a988214e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.717462 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0d508-52fa-4d30-9d7b-e58a988214e1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.733540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 393/800] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:10.735558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed578386-f62a-4d73-a5bf-a089b4d81036 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.735842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed578386-f62a-4d73-a5bf-a089b4d81036 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.736110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed578386-f62a-4d73-a5bf-a089b4d81036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.762271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ed578386-f62a-4d73-a5bf-a089b4d81036 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:10.763736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ed578386-f62a-4d73-a5bf-a089b4d81036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:10.816836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.822202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656b7e-2af0-4330-9961-8fcb507fe82b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.859121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 394/801] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:10.860183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed578386-f62a-4d73-a5bf-a089b4d81036 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.866486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038820cb-6e66-45fb-897c-114b391a02e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.867381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038820cb-6e66-45fb-897c-114b391a02e8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.868698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038820cb-6e66-45fb-897c-114b391a02e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.869196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038820cb-6e66-45fb-897c-114b391a02e8 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.870482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038820cb-6e66-45fb-897c-114b391a02e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:10.870959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038820cb-6e66-45fb-897c-114b391a02e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.872657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038820cb-6e66-45fb-897c-114b391a02e8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.889097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 408/802] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:10.890357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038820cb-6e66-45fb-897c-114b391a02e8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.902383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.002426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed578386-f62a-4d73-a5bf-a089b4d81036 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.005405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038820cb-6e66-45fb-897c-114b391a02e8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.041719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88770759-8e68-4384-9e61-12490ec6bbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.041953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201ab29-bf73-4763-89dc-8ffcdba93a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.042589 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ab29-bf73-4763-89dc-8ffcdba93a59 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.042946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ab29-bf73-4763-89dc-8ffcdba93a59 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.043124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88770759-8e68-4384-9e61-12490ec6bbac None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.043243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ab29-bf73-4763-89dc-8ffcdba93a59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.043638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88770759-8e68-4384-9e61-12490ec6bbac None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.044054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88770759-8e68-4384-9e61-12490ec6bbac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.044794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88770759-8e68-4384-9e61-12490ec6bbac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.046611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88770759-8e68-4384-9e61-12490ec6bbac None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.052632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201ab29-bf73-4763-89dc-8ffcdba93a59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.054214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201ab29-bf73-4763-89dc-8ffcdba93a59 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-88770759-8e68-4384-9e61-12490ec6bbac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:11.055588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:11.056572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:11.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 409/803] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:11.058225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88770759-8e68-4384-9e61-12490ec6bbac None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-0201ab29-bf73-4763-89dc-8ffcdba93a59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:11.073994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:11.075225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:11.076284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 395/804] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:11.077007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654b70-d7c1-4034-9106-f0c96b1aae29 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.077301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654b70-d7c1-4034-9106-f0c96b1aae29 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.077580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654b70-d7c1-4034-9106-f0c96b1aae29 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.079185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 396/805] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:11.080033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654b70-d7c1-4034-9106-f0c96b1aae29 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.094230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.169474 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.178423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88770759-8e68-4384-9e61-12490ec6bbac None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.192573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654b70-d7c1-4034-9106-f0c96b1aae29 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.213955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bd288-28b1-4f91-8e87-000654dbd448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.214620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bd288-28b1-4f91-8e87-000654dbd448 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.214926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bd288-28b1-4f91-8e87-000654dbd448 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.215198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bd288-28b1-4f91-8e87-000654dbd448 None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/7345509ac3604cf99c0e9ef232afcd09/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.217987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bd288-28b1-4f91-8e87-000654dbd448 None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=7345509ac3604cf99c0e9ef232afcd09, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.218509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bd288-28b1-4f91-8e87-000654dbd448 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.228361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164ee9-c0d9-4ce9-99d2-0aa8f5909d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.229035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164ee9-c0d9-4ce9-99d2-0aa8f5909d3e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.229318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164ee9-c0d9-4ce9-99d2-0aa8f5909d3e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.229597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164ee9-c0d9-4ce9-99d2-0aa8f5909d3e None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.230242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e164ee9-c0d9-4ce9-99d2-0aa8f5909d3e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:11.230535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e164ee9-c0d9-4ce9-99d2-0aa8f5909d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.231968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e164ee9-c0d9-4ce9-99d2-0aa8f5909d3e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.232154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 410/806] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:11 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/7345509ac3604cf99c0e9ef232afcd09/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:35:11.233143 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bd288-28b1-4f91-8e87-000654dbd448 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.237001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 397/807] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:11.238577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cc64e-7acc-450e-8ee6-e8271c5c898d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.239027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cc64e-7acc-450e-8ee6-e8271c5c898d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.239238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cc64e-7acc-450e-8ee6-e8271c5c898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.260248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ff2cc64e-7acc-450e-8ee6-e8271c5c898d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:11.261540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ff2cc64e-7acc-450e-8ee6-e8271c5c898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:11.338684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.354337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 398/808] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:11.355234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cc64e-7acc-450e-8ee6-e8271c5c898d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.368447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bd288-28b1-4f91-8e87-000654dbd448 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.422576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4cca4-bbd6-46d0-8aaf-c626f90a45e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.423312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4cca4-bbd6-46d0-8aaf-c626f90a45e1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.423592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4cca4-bbd6-46d0-8aaf-c626f90a45e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.423867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4cca4-bbd6-46d0-8aaf-c626f90a45e1 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.424904 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4cca4-bbd6-46d0-8aaf-c626f90a45e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:11.425212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4cca4-bbd6-46d0-8aaf-c626f90a45e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.427113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4cca4-bbd6-46d0-8aaf-c626f90a45e1 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.453157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 411/809] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:11.453656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.459858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4cca4-bbd6-46d0-8aaf-c626f90a45e1 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.487938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cc64e-7acc-450e-8ee6-e8271c5c898d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.530035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1190b-dae9-48ff-b959-4b1a283aff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.530678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1190b-dae9-48ff-b959-4b1a283aff16 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.530988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1190b-dae9-48ff-b959-4b1a283aff16 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.531263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1190b-dae9-48ff-b959-4b1a283aff16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.545432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1190b-dae9-48ff-b959-4b1a283aff16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e9f1190b-dae9-48ff-b959-4b1a283aff16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:11.556247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:11.557446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:11.558456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 399/810] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:11.562980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1190b-dae9-48ff-b959-4b1a283aff16 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.583727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4cca4-bbd6-46d0-8aaf-c626f90a45e1 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.631965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70784850-58cd-49ea-8927-66c0963029e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.632732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70784850-58cd-49ea-8927-66c0963029e2 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.633012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70784850-58cd-49ea-8927-66c0963029e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.633547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70784850-58cd-49ea-8927-66c0963029e2 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.634189 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70784850-58cd-49ea-8927-66c0963029e2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:11.634498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70784850-58cd-49ea-8927-66c0963029e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.635911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70784850-58cd-49ea-8927-66c0963029e2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.643272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 412/811] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:11.644436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70784850-58cd-49ea-8927-66c0963029e2 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.649451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.685752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1190b-dae9-48ff-b959-4b1a283aff16 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.725528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.732171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7670-65c4-4bdb-830f-bd5f39dc2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.732785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7670-65c4-4bdb-830f-bd5f39dc2042 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.733064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7670-65c4-4bdb-830f-bd5f39dc2042 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.733332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7670-65c4-4bdb-830f-bd5f39dc2042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.753355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70784850-58cd-49ea-8927-66c0963029e2 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.798411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a714f-4ef3-4ac2-8228-86d1d0fa61cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.799050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a714f-4ef3-4ac2-8228-86d1d0fa61cf None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.799326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a714f-4ef3-4ac2-8228-86d1d0fa61cf None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.799597 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a714f-4ef3-4ac2-8228-86d1d0fa61cf None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.800252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a714f-4ef3-4ac2-8228-86d1d0fa61cf None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:11.801129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a714f-4ef3-4ac2-8228-86d1d0fa61cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.802618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a714f-4ef3-4ac2-8228-86d1d0fa61cf None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.816899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 413/812] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:11.816899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a714f-4ef3-4ac2-8228-86d1d0fa61cf None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.827896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7670-65c4-4bdb-830f-bd5f39dc2042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.829469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7670-65c4-4bdb-830f-bd5f39dc2042 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.882981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.924450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a714f-4ef3-4ac2-8228-86d1d0fa61cf None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.950670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 400/813] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:11.950670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7670-65c4-4bdb-830f-bd5f39dc2042 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.966348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a793d-a2ea-4b19-919f-dcbe3e1250e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.967081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a793d-a2ea-4b19-919f-dcbe3e1250e4 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.967358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a793d-a2ea-4b19-919f-dcbe3e1250e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.967625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a793d-a2ea-4b19-919f-dcbe3e1250e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.968352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a793d-a2ea-4b19-919f-dcbe3e1250e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.969645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a793d-a2ea-4b19-919f-dcbe3e1250e4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.984236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.000916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 414/814] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:12.000916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a793d-a2ea-4b19-919f-dcbe3e1250e4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.086297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7670-65c4-4bdb-830f-bd5f39dc2042 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.132929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a793d-a2ea-4b19-919f-dcbe3e1250e4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.141126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ccd19-6714-42d6-966c-67ce6b898ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.141759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ccd19-6714-42d6-966c-67ce6b898ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.142710 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ccd19-6714-42d6-966c-67ce6b898ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.143079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ccd19-6714-42d6-966c-67ce6b898ef2 None admin] PATH_INFO: `/v3/services/network` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.143786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ccd19-6714-42d6-966c-67ce6b898ef2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.145806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ccd19-6714-42d6-966c-67ce6b898ef2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.156631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-693ccd19-6714-42d6-966c-67ce6b898ef2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:12.157035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:12.158044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:35:12.158989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:12.162963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 401/815] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:12.165049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ccd19-6714-42d6-966c-67ce6b898ef2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.188435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02b82-35f8-4004-a937-44773265b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.189449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02b82-35f8-4004-a937-44773265b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.189737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02b82-35f8-4004-a937-44773265b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.190011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02b82-35f8-4004-a937-44773265b1e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.203550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02b82-35f8-4004-a937-44773265b1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.205856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02b82-35f8-4004-a937-44773265b1e2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-cfd02b82-35f8-4004-a937-44773265b1e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:12.223344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:12.224545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:12.225456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:12.225456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:12.225456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:12.227812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 415/816] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:12.229096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02b82-35f8-4004-a937-44773265b1e2 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.295657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.302930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ccd19-6714-42d6-966c-67ce6b898ef2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.339380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d8d37-0afd-4e48-b3e1-6bb96a30e83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.340029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d8d37-0afd-4e48-b3e1-6bb96a30e83a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.340310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d8d37-0afd-4e48-b3e1-6bb96a30e83a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.340584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d8d37-0afd-4e48-b3e1-6bb96a30e83a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.352625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d8d37-0afd-4e48-b3e1-6bb96a30e83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.354102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d8d37-0afd-4e48-b3e1-6bb96a30e83a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.357013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02b82-35f8-4004-a937-44773265b1e2 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-a60d8d37-0afd-4e48-b3e1-6bb96a30e83a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:12.369243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:12.370439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:12.371734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:12.371734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:12.371734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:12.371734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 402/817] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:12.371734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d8d37-0afd-4e48-b3e1-6bb96a30e83a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.402544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e5b25-09fc-41bf-bfa4-3ff4574bf903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.403555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5b25-09fc-41bf-bfa4-3ff4574bf903 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.404029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5b25-09fc-41bf-bfa4-3ff4574bf903 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.404540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5b25-09fc-41bf-bfa4-3ff4574bf903 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.405458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e5b25-09fc-41bf-bfa4-3ff4574bf903 None admin] RBAC: Adding query filter params (name=network) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:12.405996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e5b25-09fc-41bf-bfa4-3ff4574bf903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.407780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e5b25-09fc-41bf-bfa4-3ff4574bf903 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.418802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 416/818] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:12.420038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e5b25-09fc-41bf-bfa4-3ff4574bf903 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.459181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.486722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d8d37-0afd-4e48-b3e1-6bb96a30e83a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.526306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95048177-497f-4e37-8b8b-70a7e3b5284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.527024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95048177-497f-4e37-8b8b-70a7e3b5284c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.527328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95048177-497f-4e37-8b8b-70a7e3b5284c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.527606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95048177-497f-4e37-8b8b-70a7e3b5284c None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.528256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95048177-497f-4e37-8b8b-70a7e3b5284c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:12.528562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95048177-497f-4e37-8b8b-70a7e3b5284c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.530380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95048177-497f-4e37-8b8b-70a7e3b5284c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.536600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e5b25-09fc-41bf-bfa4-3ff4574bf903 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.544913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 403/819] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:12.550759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95048177-497f-4e37-8b8b-70a7e3b5284c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.563639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.577830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b7d62-33f9-4b04-a6f4-0fef378fa66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.578893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b7d62-33f9-4b04-a6f4-0fef378fa66f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.579249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b7d62-33f9-4b04-a6f4-0fef378fa66f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.579627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b7d62-33f9-4b04-a6f4-0fef378fa66f None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.580352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b7d62-33f9-4b04-a6f4-0fef378fa66f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:12.580737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b7d62-33f9-4b04-a6f4-0fef378fa66f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.583069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b7d62-33f9-4b04-a6f4-0fef378fa66f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.599987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 417/820] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:12.601085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b7d62-33f9-4b04-a6f4-0fef378fa66f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.689472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95048177-497f-4e37-8b8b-70a7e3b5284c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.724739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.730535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0044b0b-6821-451d-924a-53d776776563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.731355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0044b0b-6821-451d-924a-53d776776563 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.731773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0044b0b-6821-451d-924a-53d776776563 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.732281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0044b0b-6821-451d-924a-53d776776563 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.732404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b7d62-33f9-4b04-a6f4-0fef378fa66f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.733157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0044b0b-6821-451d-924a-53d776776563 None admin] RBAC: Adding query filter params (type=network) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:12.733623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0044b0b-6821-451d-924a-53d776776563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.735443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0044b0b-6821-451d-924a-53d776776563 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.741446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 404/821] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:12.742626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0044b0b-6821-451d-924a-53d776776563 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.788580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f87df-3704-4e6e-9002-2ea8a2584279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.789233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f87df-3704-4e6e-9002-2ea8a2584279 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.789512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f87df-3704-4e6e-9002-2ea8a2584279 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.789793 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f87df-3704-4e6e-9002-2ea8a2584279 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.800278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f87df-3704-4e6e-9002-2ea8a2584279 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.801853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f87df-3704-4e6e-9002-2ea8a2584279 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-467f87df-3704-4e6e-9002-2ea8a2584279 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:12.819346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:12.820400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:12.821371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:12.822663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 418/822] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:12.822663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f87df-3704-4e6e-9002-2ea8a2584279 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.827052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.860138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0044b0b-6821-451d-924a-53d776776563 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.900037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee42065-e9a6-4aa9-9538-85ee9a8faea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.900674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee42065-e9a6-4aa9-9538-85ee9a8faea4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.901095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee42065-e9a6-4aa9-9538-85ee9a8faea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.901372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee42065-e9a6-4aa9-9538-85ee9a8faea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.908987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee42065-e9a6-4aa9-9538-85ee9a8faea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.911233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee42065-e9a6-4aa9-9538-85ee9a8faea4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-7ee42065-e9a6-4aa9-9538-85ee9a8faea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:12.924950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:12.926673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:12.928014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:12.928014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:12.928014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:12.928014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:12.928014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:12.928014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:12.928014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:12.928014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:12.930973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 405/823] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:12.931812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee42065-e9a6-4aa9-9538-85ee9a8faea4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.970653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f87df-3704-4e6e-9002-2ea8a2584279 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.013884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1db4f2-7fdd-46b4-9b64-46b74ca1db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.014419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1db4f2-7fdd-46b4-9b64-46b74ca1db39 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.014693 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1db4f2-7fdd-46b4-9b64-46b74ca1db39 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.015000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1db4f2-7fdd-46b4-9b64-46b74ca1db39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.015824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1db4f2-7fdd-46b4-9b64-46b74ca1db39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.017776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1db4f2-7fdd-46b4-9b64-46b74ca1db39 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.042621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 419/824] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:12 2022] POST /identity/v3/endpoints => generated 337 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:13.043934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1db4f2-7fdd-46b4-9b64-46b74ca1db39 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.074027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee42065-e9a6-4aa9-9538-85ee9a8faea4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.077902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.130235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.153560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18833eb-3a24-4a53-8583-da5d208da913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.154326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18833eb-3a24-4a53-8583-da5d208da913 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.154603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18833eb-3a24-4a53-8583-da5d208da913 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.154914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18833eb-3a24-4a53-8583-da5d208da913 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.155657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18833eb-3a24-4a53-8583-da5d208da913 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:13.155959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18833eb-3a24-4a53-8583-da5d208da913 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.157441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18833eb-3a24-4a53-8583-da5d208da913 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.197307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 406/825] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:13.203981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18833eb-3a24-4a53-8583-da5d208da913 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.265150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1db4f2-7fdd-46b4-9b64-46b74ca1db39 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.312169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc5e42-9593-44de-8920-755b1fc33474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.313255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5e42-9593-44de-8920-755b1fc33474 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.313534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5e42-9593-44de-8920-755b1fc33474 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.313808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5e42-9593-44de-8920-755b1fc33474 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.314507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc5e42-9593-44de-8920-755b1fc33474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:13.315666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc5e42-9593-44de-8920-755b1fc33474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.317202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc5e42-9593-44de-8920-755b1fc33474 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.330377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 420/826] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:13.332303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8c0ea-a85f-4e55-bc37-cbe523a773b8 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.332599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8c0ea-a85f-4e55-bc37-cbe523a773b8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.332991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8c0ea-a85f-4e55-bc37-cbe523a773b8 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.334732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 421/827] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:13.341255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41a43-f69a-4974-b13e-e051f3cc518f None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.341534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41a43-f69a-4974-b13e-e051f3cc518f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.341834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41a43-f69a-4974-b13e-e051f3cc518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.344123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18833eb-3a24-4a53-8583-da5d208da913 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.368531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-46e41a43-f69a-4974-b13e-e051f3cc518f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:13.368893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-46e41a43-f69a-4974-b13e-e051f3cc518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:13.386091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc5991-8a01-4f44-acf4-4a9fa7f0673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.386906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc5991-8a01-4f44-acf4-4a9fa7f0673a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.387032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc5991-8a01-4f44-acf4-4a9fa7f0673a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.387297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc5991-8a01-4f44-acf4-4a9fa7f0673a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.402087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc5991-8a01-4f44-acf4-4a9fa7f0673a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.404322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc5991-8a01-4f44-acf4-4a9fa7f0673a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-a4bc5991-8a01-4f44-acf4-4a9fa7f0673a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:13.422389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:13.423650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:13.424871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:13.424871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:13.424871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:13.424871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 407/828] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:13.424871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc5991-8a01-4f44-acf4-4a9fa7f0673a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.451867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.462979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 422/829] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:13.463931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e41a43-f69a-4974-b13e-e051f3cc518f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.475922 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.542385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc5991-8a01-4f44-acf4-4a9fa7f0673a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.585185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ee53-41a0-45de-bdad-3201298f5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.585889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ee53-41a0-45de-bdad-3201298f5f84 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.586168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ee53-41a0-45de-bdad-3201298f5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.586439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ee53-41a0-45de-bdad-3201298f5f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.587248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ee53-41a0-45de-bdad-3201298f5f84 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=d6e704b8291b4934a20cdde2ef127493) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:13.587562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ee53-41a0-45de-bdad-3201298f5f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.589015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ee53-41a0-45de-bdad-3201298f5f84 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.598032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 408/830] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/role_assignments?user.id=d6e704b8291b4934a20cdde2ef127493&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:13.616998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e41a43-f69a-4974-b13e-e051f3cc518f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.659050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781c02-e860-402f-a2fb-1687d53b0308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.660611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781c02-e860-402f-a2fb-1687d53b0308 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.660611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781c02-e860-402f-a2fb-1687d53b0308 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.661110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781c02-e860-402f-a2fb-1687d53b0308 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.661911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781c02-e860-402f-a2fb-1687d53b0308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:13.662325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781c02-e860-402f-a2fb-1687d53b0308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.663871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781c02-e860-402f-a2fb-1687d53b0308 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.677806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 423/831] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:13.683368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ee53-41a0-45de-bdad-3201298f5f84 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.752125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781c02-e860-402f-a2fb-1687d53b0308 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.812715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ee53-41a0-45de-bdad-3201298f5f84 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.814223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.834180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.856907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2efbc-7da2-4007-81da-2667b686aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.856907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2efbc-7da2-4007-81da-2667b686aaac None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.856907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2efbc-7da2-4007-81da-2667b686aaac None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.857357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2efbc-7da2-4007-81da-2667b686aaac None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.867435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2efbc-7da2-4007-81da-2667b686aaac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.869061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2efbc-7da2-4007-81da-2667b686aaac None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.882281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781c02-e860-402f-a2fb-1687d53b0308 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-68b2efbc-7da2-4007-81da-2667b686aaac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:13.882983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:13.884874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:13.886629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:13.886629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:13.886629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:13.886629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:13.886629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:13.886629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:13.886629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:13.886629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:13.886629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 409/832] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:13.891206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2efbc-7da2-4007-81da-2667b686aaac None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.936309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e602afa-d85d-42bb-82e4-fc6a69c378b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.937481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e602afa-d85d-42bb-82e4-fc6a69c378b5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.938140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e602afa-d85d-42bb-82e4-fc6a69c378b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.938586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e602afa-d85d-42bb-82e4-fc6a69c378b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.951985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e602afa-d85d-42bb-82e4-fc6a69c378b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-0e602afa-d85d-42bb-82e4-fc6a69c378b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:13.960194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:13.961184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:13.962020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:13.964633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 424/833] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:13.969830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e602afa-d85d-42bb-82e4-fc6a69c378b5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.020887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2efbc-7da2-4007-81da-2667b686aaac None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.057806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2cf8a-f917-4ba1-b70d-83a14f17bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.058823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2cf8a-f917-4ba1-b70d-83a14f17bed5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.059361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2cf8a-f917-4ba1-b70d-83a14f17bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.059840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2cf8a-f917-4ba1-b70d-83a14f17bed5 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.060732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2cf8a-f917-4ba1-b70d-83a14f17bed5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:14.061241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2cf8a-f917-4ba1-b70d-83a14f17bed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.062956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2cf8a-f917-4ba1-b70d-83a14f17bed5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.076681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 410/834] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:14.083313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2cf8a-f917-4ba1-b70d-83a14f17bed5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.092995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e602afa-d85d-42bb-82e4-fc6a69c378b5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.111524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.115679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.131876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d58530-093c-43e2-bd43-1b7a77e21efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.132494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58530-093c-43e2-bd43-1b7a77e21efd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.132771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58530-093c-43e2-bd43-1b7a77e21efd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.133044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58530-093c-43e2-bd43-1b7a77e21efd None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.133970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d58530-093c-43e2-bd43-1b7a77e21efd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:14.134272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d58530-093c-43e2-bd43-1b7a77e21efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.135671 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d58530-093c-43e2-bd43-1b7a77e21efd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.145427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 425/835] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:14.146959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c0826-368a-48b3-8495-a02caa07c6de None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.147243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c0826-368a-48b3-8495-a02caa07c6de None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.147513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c0826-368a-48b3-8495-a02caa07c6de None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.148834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 426/836] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:14.151631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c0826-368a-48b3-8495-a02caa07c6de None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.206008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2cf8a-f917-4ba1-b70d-83a14f17bed5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.243282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab6fc2-140a-455a-a078-ba1fd4be8040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.244288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab6fc2-140a-455a-a078-ba1fd4be8040 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.244782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab6fc2-140a-455a-a078-ba1fd4be8040 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.245343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab6fc2-140a-455a-a078-ba1fd4be8040 None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/18429472ab6b403ea10105bf9239ce21/roles/04d187050a844fdf95f14768fd866f8e` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.262107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab6fc2-140a-455a-a078-ba1fd4be8040 None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=18429472ab6b403ea10105bf9239ce21, role_id=04d187050a844fdf95f14768fd866f8e)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.263909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c0826-368a-48b3-8495-a02caa07c6de None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.265285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab6fc2-140a-455a-a078-ba1fd4be8040 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.287092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 411/837] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:14 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/18429472ab6b403ea10105bf9239ce21/roles/04d187050a844fdf95f14768fd866f8e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:35:14.288838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6b0f-72a0-41c0-8dc6-59bed7a59fbd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.289166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6b0f-72a0-41c0-8dc6-59bed7a59fbd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.289438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6b0f-72a0-41c0-8dc6-59bed7a59fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.302650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cd851-1f19-4459-8b51-f800841b82dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.303441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cd851-1f19-4459-8b51-f800841b82dd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.303763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cd851-1f19-4459-8b51-f800841b82dd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.304036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cd851-1f19-4459-8b51-f800841b82dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.315744 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fd8b6b0f-72a0-41c0-8dc6-59bed7a59fbd None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:14.317093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cd851-1f19-4459-8b51-f800841b82dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.317602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fd8b6b0f-72a0-41c0-8dc6-59bed7a59fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:14.318801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cd851-1f19-4459-8b51-f800841b82dd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-373cd851-1f19-4459-8b51-f800841b82dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:14.335626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:14.336875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:14.338012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:14.338012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:14.338012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:14.339360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 427/838] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:14.350994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cd851-1f19-4459-8b51-f800841b82dd None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.413925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 412/839] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:14.415188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.467954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cd851-1f19-4459-8b51-f800841b82dd None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.506322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13344794-d579-4896-b0c3-86fea61b26ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.507273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13344794-d579-4896-b0c3-86fea61b26ae None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.507733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13344794-d579-4896-b0c3-86fea61b26ae None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.508427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13344794-d579-4896-b0c3-86fea61b26ae None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.509263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13344794-d579-4896-b0c3-86fea61b26ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:14.509761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13344794-d579-4896-b0c3-86fea61b26ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.511448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13344794-d579-4896-b0c3-86fea61b26ae None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.525238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 428/840] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:14.531422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6b0f-72a0-41c0-8dc6-59bed7a59fbd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.541735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.645696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6b0f-72a0-41c0-8dc6-59bed7a59fbd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.682405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4cf7f-145d-43c2-a336-09390abfd7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.683420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4cf7f-145d-43c2-a336-09390abfd7a7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.683897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4cf7f-145d-43c2-a336-09390abfd7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.684358 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4cf7f-145d-43c2-a336-09390abfd7a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.690445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13344794-d579-4896-b0c3-86fea61b26ae None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.692978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4cf7f-145d-43c2-a336-09390abfd7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.694669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4cf7f-145d-43c2-a336-09390abfd7a7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-bbe4cf7f-145d-43c2-a336-09390abfd7a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:14.707489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:14.708819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:35:14.710075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:14.711654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 413/841] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:14.717211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4cf7f-145d-43c2-a336-09390abfd7a7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.784436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.809998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.817670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13344794-d579-4896-b0c3-86fea61b26ae None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.832774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4cf7f-145d-43c2-a336-09390abfd7a7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.857066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aed179-da48-43d0-9775-d0460970a3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.857622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed179-da48-43d0-9775-d0460970a3cc None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.857900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed179-da48-43d0-9775-d0460970a3cc None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.858167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed179-da48-43d0-9775-d0460970a3cc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.858746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aed179-da48-43d0-9775-d0460970a3cc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.860145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aed179-da48-43d0-9775-d0460970a3cc None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-a0aed179-da48-43d0-9775-d0460970a3cc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:14.869347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:14.870379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:14.871302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 429/842] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:14.874514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7712b-2c6d-45e0-b5bc-ab8d6abd9897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.880695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7712b-2c6d-45e0-b5bc-ab8d6abd9897 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.880695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7712b-2c6d-45e0-b5bc-ab8d6abd9897 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.880695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7712b-2c6d-45e0-b5bc-ab8d6abd9897 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.880695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7712b-2c6d-45e0-b5bc-ab8d6abd9897 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:14.880695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7712b-2c6d-45e0-b5bc-ab8d6abd9897 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.880695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7712b-2c6d-45e0-b5bc-ab8d6abd9897 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.881325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aed179-da48-43d0-9775-d0460970a3cc None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.902634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 414/843] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:14.903683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7712b-2c6d-45e0-b5bc-ab8d6abd9897 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.001210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aed179-da48-43d0-9775-d0460970a3cc None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.013542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7712b-2c6d-45e0-b5bc-ab8d6abd9897 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.034806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.043998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1360e-5ac7-4e0b-8452-162dd7d1665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.045110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1360e-5ac7-4e0b-8452-162dd7d1665d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.045752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1360e-5ac7-4e0b-8452-162dd7d1665d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.046331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1360e-5ac7-4e0b-8452-162dd7d1665d None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.047556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1360e-5ac7-4e0b-8452-162dd7d1665d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:15.048129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1360e-5ac7-4e0b-8452-162dd7d1665d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.050179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca3a60-086c-4abd-965a-52b5926e9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.050419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1360e-5ac7-4e0b-8452-162dd7d1665d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.051080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca3a60-086c-4abd-965a-52b5926e9799 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.051456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca3a60-086c-4abd-965a-52b5926e9799 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.051822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca3a60-086c-4abd-965a-52b5926e9799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.061183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 430/844] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:15.062368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1360e-5ac7-4e0b-8452-162dd7d1665d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.092145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.124146 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca3a60-086c-4abd-965a-52b5926e9799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.125685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca3a60-086c-4abd-965a-52b5926e9799 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.179313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1360e-5ac7-4e0b-8452-162dd7d1665d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.218966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15ee55-bb05-4d35-a157-c853d0152d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.219870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15ee55-bb05-4d35-a157-c853d0152d8f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.220315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15ee55-bb05-4d35-a157-c853d0152d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.220728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15ee55-bb05-4d35-a157-c853d0152d8f None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.221505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15ee55-bb05-4d35-a157-c853d0152d8f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:15.222054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15ee55-bb05-4d35-a157-c853d0152d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.224178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15ee55-bb05-4d35-a157-c853d0152d8f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.236222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 415/845] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:15.236421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 431/846] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:15.239938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca3a60-086c-4abd-965a-52b5926e9799 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.283158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.351616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca3a60-086c-4abd-965a-52b5926e9799 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.391040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a7112-d36a-4f4a-ba0b-989ba8738322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.391601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a7112-d36a-4f4a-ba0b-989ba8738322 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.391876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a7112-d36a-4f4a-ba0b-989ba8738322 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.392141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a7112-d36a-4f4a-ba0b-989ba8738322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.403417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a7112-d36a-4f4a-ba0b-989ba8738322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.404872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a7112-d36a-4f4a-ba0b-989ba8738322 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-810a7112-d36a-4f4a-ba0b-989ba8738322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:15.420773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:15.421796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:15.422727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:15.422727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:15.422727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:15.422727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 416/847] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:15.429382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15ee55-bb05-4d35-a157-c853d0152d8f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.524857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.541987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15ee55-bb05-4d35-a157-c853d0152d8f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.578590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2b30d-299b-4e4a-a247-06f12e1dc415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.579634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2b30d-299b-4e4a-a247-06f12e1dc415 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.580496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2b30d-299b-4e4a-a247-06f12e1dc415 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.580976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2b30d-299b-4e4a-a247-06f12e1dc415 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.582881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2b30d-299b-4e4a-a247-06f12e1dc415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:15.583401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2b30d-299b-4e4a-a247-06f12e1dc415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.584995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2b30d-299b-4e4a-a247-06f12e1dc415 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.599335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 432/848] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:15.605097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a7112-d36a-4f4a-ba0b-989ba8738322 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.679585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.684198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98cad2-de17-4ca3-b083-ce16e6c1f438 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.684484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98cad2-de17-4ca3-b083-ce16e6c1f438 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.684758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98cad2-de17-4ca3-b083-ce16e6c1f438 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.686356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 433/849] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:15.691863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c67d2-cc4b-4f04-8e5e-254c1fe75baa None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.692217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c67d2-cc4b-4f04-8e5e-254c1fe75baa None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.692588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c67d2-cc4b-4f04-8e5e-254c1fe75baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.711708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ad2c67d2-cc4b-4f04-8e5e-254c1fe75baa None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:15.713099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ad2c67d2-cc4b-4f04-8e5e-254c1fe75baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:15.713475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a7112-d36a-4f4a-ba0b-989ba8738322 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.749035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc380d-eb3e-4f11-8b38-5c0e14b6acf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.749661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc380d-eb3e-4f11-8b38-5c0e14b6acf3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.749935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc380d-eb3e-4f11-8b38-5c0e14b6acf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.750200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc380d-eb3e-4f11-8b38-5c0e14b6acf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.758942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc380d-eb3e-4f11-8b38-5c0e14b6acf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.760401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc380d-eb3e-4f11-8b38-5c0e14b6acf3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-a5dc380d-eb3e-4f11-8b38-5c0e14b6acf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:15.772170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:15.773102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:15.774658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:15.774658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:15.774658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:15.774658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:15.774658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:15.774658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:15.774658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:15.774658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:15.774658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 417/850] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:15.778958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc380d-eb3e-4f11-8b38-5c0e14b6acf3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.799165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 434/851] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:15.885456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc380d-eb3e-4f11-8b38-5c0e14b6acf3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.924338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.929788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42a1b-c23c-4a52-956c-243747ed7274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.930368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42a1b-c23c-4a52-956c-243747ed7274 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.930653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42a1b-c23c-4a52-956c-243747ed7274 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.931170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42a1b-c23c-4a52-956c-243747ed7274 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.931866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e42a1b-c23c-4a52-956c-243747ed7274 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:15.932167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e42a1b-c23c-4a52-956c-243747ed7274 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.933606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e42a1b-c23c-4a52-956c-243747ed7274 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.947115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 418/852] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:15.952874 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c67d2-cc4b-4f04-8e5e-254c1fe75baa None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:16.035353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:16.060985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c67d2-cc4b-4f04-8e5e-254c1fe75baa None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:16.083529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42a1b-c23c-4a52-956c-243747ed7274 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:16.097860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1d390-d865-47fc-9c73-1f72f2bff016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:16.098476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1d390-d865-47fc-9c73-1f72f2bff016 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.098756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1d390-d865-47fc-9c73-1f72f2bff016 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.099050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1d390-d865-47fc-9c73-1f72f2bff016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.099829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1d390-d865-47fc-9c73-1f72f2bff016 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=7345509ac3604cf99c0e9ef232afcd09) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:16.100139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1d390-d865-47fc-9c73-1f72f2bff016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:16.101675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1d390-d865-47fc-9c73-1f72f2bff016 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:16.108228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 435/853] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/role_assignments?user.id=7345509ac3604cf99c0e9ef232afcd09&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:16.206555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42a1b-c23c-4a52-956c-243747ed7274 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:16.247189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad7f6e-9f57-43dc-b5c8-e40008c6d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:16.248192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad7f6e-9f57-43dc-b5c8-e40008c6d934 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.248667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad7f6e-9f57-43dc-b5c8-e40008c6d934 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.249156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad7f6e-9f57-43dc-b5c8-e40008c6d934 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.249960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad7f6e-9f57-43dc-b5c8-e40008c6d934 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:16.251559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad7f6e-9f57-43dc-b5c8-e40008c6d934 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-60ad7f6e-9f57-43dc-b5c8-e40008c6d934 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:16.262627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:16.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:16.264535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 419/854] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Aug 18 20:35:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:16.270306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1d390-d865-47fc-9c73-1f72f2bff016 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:16.362377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5b00f-e934-431b-a149-0299c584e1cb None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.363294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5b00f-e934-431b-a149-0299c584e1cb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.363838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5b00f-e934-431b-a149-0299c584e1cb None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.365505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 420/855] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:16.372512 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bab1e-2c9a-43f1-9b04-43d70180eddf None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.373076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bab1e-2c9a-43f1-9b04-43d70180eddf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.373254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bab1e-2c9a-43f1-9b04-43d70180eddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.379509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1d390-d865-47fc-9c73-1f72f2bff016 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:16.393851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-935bab1e-2c9a-43f1-9b04-43d70180eddf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:16.395577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-935bab1e-2c9a-43f1-9b04-43d70180eddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:16.417440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b23048-626d-464b-945f-c2979cca25e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:16.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23048-626d-464b-945f-c2979cca25e0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.418511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23048-626d-464b-945f-c2979cca25e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.418894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23048-626d-464b-945f-c2979cca25e0 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.419595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b23048-626d-464b-945f-c2979cca25e0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:16.420155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b23048-626d-464b-945f-c2979cca25e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:16.421630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b23048-626d-464b-945f-c2979cca25e0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:16.427877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 436/856] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:16.433921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b23048-626d-464b-945f-c2979cca25e0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:16.438938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:16.467317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:16.491420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 421/857] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:16.556636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b23048-626d-464b-945f-c2979cca25e0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:16.592600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae51d2b-adbd-4364-9562-83a4388db73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:16.593500 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae51d2b-adbd-4364-9562-83a4388db73d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.593930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae51d2b-adbd-4364-9562-83a4388db73d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.594349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae51d2b-adbd-4364-9562-83a4388db73d None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.595203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae51d2b-adbd-4364-9562-83a4388db73d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:16.595654 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae51d2b-adbd-4364-9562-83a4388db73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:16.598800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae51d2b-adbd-4364-9562-83a4388db73d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:16.603491 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 437/858] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:16.778343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bab1e-2c9a-43f1-9b04-43d70180eddf None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:16.888578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bab1e-2c9a-43f1-9b04-43d70180eddf None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:16.925360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06373e-bf8c-4199-bd84-6908fd8430f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:16.926010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06373e-bf8c-4199-bd84-6908fd8430f9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.926291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06373e-bf8c-4199-bd84-6908fd8430f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.926566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06373e-bf8c-4199-bd84-6908fd8430f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.937807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06373e-bf8c-4199-bd84-6908fd8430f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2d06373e-bf8c-4199-bd84-6908fd8430f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:16.942658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:16.943623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:16.944927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 422/859] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:16.951944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae51d2b-adbd-4364-9562-83a4388db73d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:17.024874 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:17.062695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae51d2b-adbd-4364-9562-83a4388db73d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:17.098565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b845b-cd44-4d0a-90b2-c84690c600b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:17.099232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b845b-cd44-4d0a-90b2-c84690c600b3 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.099516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b845b-cd44-4d0a-90b2-c84690c600b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.099787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b845b-cd44-4d0a-90b2-c84690c600b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.100574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b845b-cd44-4d0a-90b2-c84690c600b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:17.100877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b845b-cd44-4d0a-90b2-c84690c600b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:17.102429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b845b-cd44-4d0a-90b2-c84690c600b3 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:17.114881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 438/860] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:17.117650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06373e-bf8c-4199-bd84-6908fd8430f9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:17.173469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:17.234605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06373e-bf8c-4199-bd84-6908fd8430f9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:17.270852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200ecc-c298-4df5-828b-08f4489075ff None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.271407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200ecc-c298-4df5-828b-08f4489075ff None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.271407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200ecc-c298-4df5-828b-08f4489075ff None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.273169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 439/861] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:17.274233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ecd9e-e05a-4a1e-99f2-53045db18b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:17.275217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ecd9e-e05a-4a1e-99f2-53045db18b91 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.275713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ecd9e-e05a-4a1e-99f2-53045db18b91 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.276187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ecd9e-e05a-4a1e-99f2-53045db18b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.280241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238c933-f39a-470d-9031-b411bcb58d24 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.280524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238c933-f39a-470d-9031-b411bcb58d24 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.280796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238c933-f39a-470d-9031-b411bcb58d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.291996 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ecd9e-e05a-4a1e-99f2-53045db18b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:17.293230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ecd9e-e05a-4a1e-99f2-53045db18b91 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:17.304146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-6238c933-f39a-470d-9031-b411bcb58d24 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:17.305656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6238c933-f39a-470d-9031-b411bcb58d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-334ecd9e-e05a-4a1e-99f2-53045db18b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:17.310861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:17.311840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:17.312859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:17.312859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:17.312859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:17.312859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 423/862] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:17.319750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ecd9e-e05a-4a1e-99f2-53045db18b91 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:17.384730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 440/863] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:17.431198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:17.433546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ecd9e-e05a-4a1e-99f2-53045db18b91 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:17.467572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a156-ea76-4812-b66f-3b2ec3710883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:17.468181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a156-ea76-4812-b66f-3b2ec3710883 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.468457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a156-ea76-4812-b66f-3b2ec3710883 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.468727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a156-ea76-4812-b66f-3b2ec3710883 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.469362 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a156-ea76-4812-b66f-3b2ec3710883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:17.469659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a156-ea76-4812-b66f-3b2ec3710883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:17.471043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a156-ea76-4812-b66f-3b2ec3710883 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:17.483613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 424/864] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:17.492076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238c933-f39a-470d-9031-b411bcb58d24 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:17.563217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:17.626704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238c933-f39a-470d-9031-b411bcb58d24 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:17.662584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad421a0d-8ad8-456c-9a35-7c2ca069e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:17.663609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad421a0d-8ad8-456c-9a35-7c2ca069e83b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.664089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad421a0d-8ad8-456c-9a35-7c2ca069e83b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.664560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad421a0d-8ad8-456c-9a35-7c2ca069e83b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.672260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad421a0d-8ad8-456c-9a35-7c2ca069e83b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:17.674000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad421a0d-8ad8-456c-9a35-7c2ca069e83b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:17.679667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a156-ea76-4812-b66f-3b2ec3710883 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-ad421a0d-8ad8-456c-9a35-7c2ca069e83b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:17.687645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:17.688627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:17.689567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:17.697321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 441/865] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:35:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:17.698901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad421a0d-8ad8-456c-9a35-7c2ca069e83b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:17.787715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a156-ea76-4812-b66f-3b2ec3710883 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:17.804834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad421a0d-8ad8-456c-9a35-7c2ca069e83b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:17.827435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc28b0-0b05-489e-b5c7-fb5d19c30850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:17.827743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc28b0-0b05-489e-b5c7-fb5d19c30850 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.827946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc28b0-0b05-489e-b5c7-fb5d19c30850 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.828218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc28b0-0b05-489e-b5c7-fb5d19c30850 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.828873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc28b0-0b05-489e-b5c7-fb5d19c30850 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:17.830365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc28b0-0b05-489e-b5c7-fb5d19c30850 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:17.838005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:17.844545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07754f9f-08e5-48c7-94bb-81bfd594d807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:17.845438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754f9f-08e5-48c7-94bb-81bfd594d807 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.845959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754f9f-08e5-48c7-94bb-81bfd594d807 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.846428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754f9f-08e5-48c7-94bb-81bfd594d807 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.847490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07754f9f-08e5-48c7-94bb-81bfd594d807 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:17.848021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07754f9f-08e5-48c7-94bb-81bfd594d807 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:17.849717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07754f9f-08e5-48c7-94bb-81bfd594d807 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:17.855255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 425/866] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:17 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:35:17.877320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 442/867] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Aug 18 20:35:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:17.879498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc28b0-0b05-489e-b5c7-fb5d19c30850 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:17.902409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.018316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc28b0-0b05-489e-b5c7-fb5d19c30850 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.056149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8ec6-f247-43cc-8027-a50a3ff99117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.056761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8ec6-f247-43cc-8027-a50a3ff99117 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.057036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8ec6-f247-43cc-8027-a50a3ff99117 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.057365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8ec6-f247-43cc-8027-a50a3ff99117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.131180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8ec6-f247-43cc-8027-a50a3ff99117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.132560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8ec6-f247-43cc-8027-a50a3ff99117 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.147769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.219626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d5cd9-def7-4cb6-9db4-dff99e6f6478 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.219957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d5cd9-def7-4cb6-9db4-dff99e6f6478 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.220180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d5cd9-def7-4cb6-9db4-dff99e6f6478 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.221783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 443/868] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:18.227364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e433f9-e289-4616-97e8-71fe700139bd None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.227694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e433f9-e289-4616-97e8-71fe700139bd None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.227974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e433f9-e289-4616-97e8-71fe700139bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.239448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 426/869] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:17 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:18.245942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8ec6-f247-43cc-8027-a50a3ff99117 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.247840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f7e433f9-e289-4616-97e8-71fe700139bd None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:18.249218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f7e433f9-e289-4616-97e8-71fe700139bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:18.338941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 444/870] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:18.356213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8ec6-f247-43cc-8027-a50a3ff99117 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.371645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.393417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0dccf-524c-410f-a210-300cf63edd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.394047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0dccf-524c-410f-a210-300cf63edd4a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.394335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0dccf-524c-410f-a210-300cf63edd4a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.394564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0dccf-524c-410f-a210-300cf63edd4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.405232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0dccf-524c-410f-a210-300cf63edd4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.406694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0dccf-524c-410f-a210-300cf63edd4a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-66c0dccf-524c-410f-a210-300cf63edd4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:18.421614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:18.422618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:18.423564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:18.423564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:18.423564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:18.427108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 427/871] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:18.429258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e433f9-e289-4616-97e8-71fe700139bd None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.530336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e433f9-e289-4616-97e8-71fe700139bd None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.539913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.572961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c914c-6f75-49f7-8c7f-0f3beae59a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.573579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c914c-6f75-49f7-8c7f-0f3beae59a86 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.573873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c914c-6f75-49f7-8c7f-0f3beae59a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.574118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c914c-6f75-49f7-8c7f-0f3beae59a86 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.574758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c914c-6f75-49f7-8c7f-0f3beae59a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:18.575091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c914c-6f75-49f7-8c7f-0f3beae59a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.576446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c914c-6f75-49f7-8c7f-0f3beae59a86 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.598553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 445/872] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:18.600820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0dccf-524c-410f-a210-300cf63edd4a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.657160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c914c-6f75-49f7-8c7f-0f3beae59a86 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.717317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0dccf-524c-410f-a210-300cf63edd4a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.752847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c48a3-d989-475b-9e77-43e04e82a196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.754137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c48a3-d989-475b-9e77-43e04e82a196 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.754419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c48a3-d989-475b-9e77-43e04e82a196 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.754698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c48a3-d989-475b-9e77-43e04e82a196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.762279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c48a3-d989-475b-9e77-43e04e82a196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.763757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c48a3-d989-475b-9e77-43e04e82a196 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.769966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c914c-6f75-49f7-8c7f-0f3beae59a86 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e91c48a3-d989-475b-9e77-43e04e82a196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:18.775438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:18.776338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:18.777243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:18.777243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:18.777243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:18.777243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:18.777243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:18.777243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:18.777243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:18.777243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:18.777243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 428/873] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:18.778179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bbbee-6529-4467-8be6-72a1dc3defcf None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.778285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bbbee-6529-4467-8be6-72a1dc3defcf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.778550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bbbee-6529-4467-8be6-72a1dc3defcf None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.783355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 429/874] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:18.784134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bbbee-6529-4467-8be6-72a1dc3defcf None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.812412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e0f83-df12-455b-afaf-1f1886d31c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.813501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0f83-df12-455b-afaf-1f1886d31c87 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.813959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0f83-df12-455b-afaf-1f1886d31c87 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.814632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0f83-df12-455b-afaf-1f1886d31c87 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.815004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e0f83-df12-455b-afaf-1f1886d31c87 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.815137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.817198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e0f83-df12-455b-afaf-1f1886d31c87 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-f99e0f83-df12-455b-afaf-1f1886d31c87 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:18.828206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:18.829442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:18.830299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 446/875] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:18.831137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d79d4-8340-4952-b8ae-fbaaa22415cd None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.831348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d79d4-8340-4952-b8ae-fbaaa22415cd None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.831872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d79d4-8340-4952-b8ae-fbaaa22415cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.851440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-9b1d79d4-8340-4952-b8ae-fbaaa22415cd None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:18.852633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9b1d79d4-8340-4952-b8ae-fbaaa22415cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:18.880863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.906305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bbbee-6529-4467-8be6-72a1dc3defcf None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.929090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 447/876] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:18.930337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d79d4-8340-4952-b8ae-fbaaa22415cd None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.953603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfae81-548f-4050-9fa5-8bf154f879c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.954221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfae81-548f-4050-9fa5-8bf154f879c6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.954503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfae81-548f-4050-9fa5-8bf154f879c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.954796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfae81-548f-4050-9fa5-8bf154f879c6 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.955576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfae81-548f-4050-9fa5-8bf154f879c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:18.955802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfae81-548f-4050-9fa5-8bf154f879c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.958283 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfae81-548f-4050-9fa5-8bf154f879c6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.971742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 430/877] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:18.978007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfae81-548f-4050-9fa5-8bf154f879c6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:19.055422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d79d4-8340-4952-b8ae-fbaaa22415cd None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.085457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:19.103221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfae81-548f-4050-9fa5-8bf154f879c6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.104491 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a041327-5179-42b1-90a1-2dbcbd625178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.106579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a041327-5179-42b1-90a1-2dbcbd625178 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.107089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a041327-5179-42b1-90a1-2dbcbd625178 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.107577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a041327-5179-42b1-90a1-2dbcbd625178 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.108430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a041327-5179-42b1-90a1-2dbcbd625178 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:19.108933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a041327-5179-42b1-90a1-2dbcbd625178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.110545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a041327-5179-42b1-90a1-2dbcbd625178 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.123166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 448/878] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:19.125075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a041327-5179-42b1-90a1-2dbcbd625178 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:19.147501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b0714-f8d6-41e2-80dd-089728c6ad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.148440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b0714-f8d6-41e2-80dd-089728c6ad37 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.148879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b0714-f8d6-41e2-80dd-089728c6ad37 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.149155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b0714-f8d6-41e2-80dd-089728c6ad37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.149891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b0714-f8d6-41e2-80dd-089728c6ad37 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=18429472ab6b403ea10105bf9239ce21) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:19.150202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b0714-f8d6-41e2-80dd-089728c6ad37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.151679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b0714-f8d6-41e2-80dd-089728c6ad37 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.160842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:19.163066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 431/879] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/role_assignments?user.id=18429472ab6b403ea10105bf9239ce21&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:19.229845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b0714-f8d6-41e2-80dd-089728c6ad37 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:19.257230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a041327-5179-42b1-90a1-2dbcbd625178 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.307528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee5327-f593-4805-a0fa-23da7e9ea1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.308190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee5327-f593-4805-a0fa-23da7e9ea1ba None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.308468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee5327-f593-4805-a0fa-23da7e9ea1ba None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.308761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee5327-f593-4805-a0fa-23da7e9ea1ba None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.309384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee5327-f593-4805-a0fa-23da7e9ea1ba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:19.309985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee5327-f593-4805-a0fa-23da7e9ea1ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.311116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee5327-f593-4805-a0fa-23da7e9ea1ba None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.317961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 449/880] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:19.381427 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b0714-f8d6-41e2-80dd-089728c6ad37 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.424171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453e1b4-0ef4-4676-b6e9-3f60bcdeaf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.424796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453e1b4-0ef4-4676-b6e9-3f60bcdeaf31 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.425610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453e1b4-0ef4-4676-b6e9-3f60bcdeaf31 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.426122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453e1b4-0ef4-4676-b6e9-3f60bcdeaf31 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.427345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453e1b4-0ef4-4676-b6e9-3f60bcdeaf31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.428767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453e1b4-0ef4-4676-b6e9-3f60bcdeaf31 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.450107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 432/881] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:19 2022] POST /identity/v3/services => generated 269 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:20.062013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa9b6e-439a-4493-91fb-6d6d25cbca40 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:20.062541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa9b6e-439a-4493-91fb-6d6d25cbca40 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:20.062541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa9b6e-439a-4493-91fb-6d6d25cbca40 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:20.064180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 450/882] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:20.069263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bf8a1-08d4-47c8-a915-c69d57c040e8 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:20.069664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bf8a1-08d4-47c8-a915-c69d57c040e8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:20.069803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bf8a1-08d4-47c8-a915-c69d57c040e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:20.088515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-857bf8a1-08d4-47c8-a915-c69d57c040e8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:20.089702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-857bf8a1-08d4-47c8-a915-c69d57c040e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:20.093452 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:20.169269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 433/883] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:20.441690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa9b6e-439a-4493-91fb-6d6d25cbca40 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:20.544030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:20.561508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa9b6e-439a-4493-91fb-6d6d25cbca40 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:20.607234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da35e8-9089-45cd-a561-1b172bcfd145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:20.607884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da35e8-9089-45cd-a561-1b172bcfd145 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:20.608168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da35e8-9089-45cd-a561-1b172bcfd145 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:20.608444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da35e8-9089-45cd-a561-1b172bcfd145 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:20.609036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da35e8-9089-45cd-a561-1b172bcfd145 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:20.610420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da35e8-9089-45cd-a561-1b172bcfd145 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-91da35e8-9089-45cd-a561-1b172bcfd145 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:20.620177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:20.621157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:35:20.622015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:20.626190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 451/884] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:35:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:20.627616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bf8a1-08d4-47c8-a915-c69d57c040e8 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:20.734949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bf8a1-08d4-47c8-a915-c69d57c040e8 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:20.774312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d112ad-76c5-4a9d-a9cb-c744e35f0d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:20.774981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d112ad-76c5-4a9d-a9cb-c744e35f0d73 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:20.775264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d112ad-76c5-4a9d-a9cb-c744e35f0d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:20.775537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d112ad-76c5-4a9d-a9cb-c744e35f0d73 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:20.776185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d112ad-76c5-4a9d-a9cb-c744e35f0d73 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:20.776492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d112ad-76c5-4a9d-a9cb-c744e35f0d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:20.777876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d112ad-76c5-4a9d-a9cb-c744e35f0d73 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:20.779828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:20.787780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 434/885] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:35:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:20.790290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da35e8-9089-45cd-a561-1b172bcfd145 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:20.897627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da35e8-9089-45cd-a561-1b172bcfd145 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:20.933396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3599-5572-4204-bfce-3ec0850205e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:20.934015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3599-5572-4204-bfce-3ec0850205e8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:20.934297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3599-5572-4204-bfce-3ec0850205e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:20.934572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3599-5572-4204-bfce-3ec0850205e8 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:20.935241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b3599-5572-4204-bfce-3ec0850205e8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:20.935544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b3599-5572-4204-bfce-3ec0850205e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:20.936919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b3599-5572-4204-bfce-3ec0850205e8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:20.946881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 452/886] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:35:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:20.948466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d112ad-76c5-4a9d-a9cb-c744e35f0d73 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:21.067006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d112ad-76c5-4a9d-a9cb-c744e35f0d73 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:21.102987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7966f-e671-4a96-9364-23ded22e200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:21.103616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7966f-e671-4a96-9364-23ded22e200a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.103881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7966f-e671-4a96-9364-23ded22e200a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.104155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7966f-e671-4a96-9364-23ded22e200a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.104933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7966f-e671-4a96-9364-23ded22e200a None admin] RBAC: Adding query filter params (interface=public, service_id=d7de29f5a763401fb457bb7861ed81c5, region_id=RegionOne) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:21.105244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7966f-e671-4a96-9364-23ded22e200a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:21.106686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7966f-e671-4a96-9364-23ded22e200a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:21.119785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 435/887] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Aug 18 20:35:20 2022] GET /identity/v3/endpoints?service_id=d7de29f5a763401fb457bb7861ed81c5&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:21.121201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3599-5572-4204-bfce-3ec0850205e8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:21.146158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:21.229320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3599-5572-4204-bfce-3ec0850205e8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:21.265306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31250ab-2f7f-4c17-8612-c29d352579b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:21.265926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31250ab-2f7f-4c17-8612-c29d352579b9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.266203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31250ab-2f7f-4c17-8612-c29d352579b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.266473 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31250ab-2f7f-4c17-8612-c29d352579b9 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.267121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31250ab-2f7f-4c17-8612-c29d352579b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:21.268553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31250ab-2f7f-4c17-8612-c29d352579b9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:21.282987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 453/888] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:21 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:35:21.350306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08db1f-4cc4-4786-8953-1a874ef3f536 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.350602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08db1f-4cc4-4786-8953-1a874ef3f536 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.350869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08db1f-4cc4-4786-8953-1a874ef3f536 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.352540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 436/889] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:21.358210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a47cf-3165-41f0-afb0-d300fec6f2ce None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.358736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a47cf-3165-41f0-afb0-d300fec6f2ce None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.359196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a47cf-3165-41f0-afb0-d300fec6f2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.379459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-4a9a47cf-3165-41f0-afb0-d300fec6f2ce None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:21.380489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60853ad-8409-4ec6-812b-4a03288daebc None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.380885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60853ad-8409-4ec6-812b-4a03288daebc None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.381269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60853ad-8409-4ec6-812b-4a03288daebc None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.381432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4a9a47cf-3165-41f0-afb0-d300fec6f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:21.383446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 437/890] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:21.388788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c30ff7-4b9a-4a22-8858-02304ee483ea None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.389070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c30ff7-4b9a-4a22-8858-02304ee483ea None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.389340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c30ff7-4b9a-4a22-8858-02304ee483ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.413414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-00c30ff7-4b9a-4a22-8858-02304ee483ea None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:21.414653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-00c30ff7-4b9a-4a22-8858-02304ee483ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:21.463580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 454/891] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:21.464094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bf4f8-e021-435a-85a6-e29e69aacdd5 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.464377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bf4f8-e021-435a-85a6-e29e69aacdd5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.464647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bf4f8-e021-435a-85a6-e29e69aacdd5 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.465893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 455/892] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:21.471271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d792a-3f03-45cc-8f1b-c47b8a8a82e9 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.471545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d792a-3f03-45cc-8f1b-c47b8a8a82e9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.471810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d792a-3f03-45cc-8f1b-c47b8a8a82e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.486385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:21.490944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a22d792a-3f03-45cc-8f1b-c47b8a8a82e9 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:21.491932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a22d792a-3f03-45cc-8f1b-c47b8a8a82e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:21.497404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 438/893] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:21.500423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:21.568835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 456/894] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:21.758113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c30ff7-4b9a-4a22-8858-02304ee483ea None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:21.787855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d792a-3f03-45cc-8f1b-c47b8a8a82e9 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:21.882100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c30ff7-4b9a-4a22-8858-02304ee483ea None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:21.920054 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f28b-c1f7-4c9f-bb4c-db4a4faff12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:21.920653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f28b-c1f7-4c9f-bb4c-db4a4faff12d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.920930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f28b-c1f7-4c9f-bb4c-db4a4faff12d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.921196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f28b-c1f7-4c9f-bb4c-db4a4faff12d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.922314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d792a-3f03-45cc-8f1b-c47b8a8a82e9 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:21.932490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f28b-c1f7-4c9f-bb4c-db4a4faff12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-6767f28b-c1f7-4c9f-bb4c-db4a4faff12d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:21.937220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:21.938172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:21.939079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 439/895] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Aug 18 20:35:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:21.939793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f28b-c1f7-4c9f-bb4c-db4a4faff12d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:21.964336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cf21a-d68b-4394-bd84-a6e0e098859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:21.964950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cf21a-d68b-4394-bd84-a6e0e098859b None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.965219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cf21a-d68b-4394-bd84-a6e0e098859b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.965486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cf21a-d68b-4394-bd84-a6e0e098859b None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.966127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cf21a-d68b-4394-bd84-a6e0e098859b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:21.967763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cf21a-d68b-4394-bd84-a6e0e098859b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:21.986824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 457/896] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:21 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:21.986824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cf21a-d68b-4394-bd84-a6e0e098859b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:21.991248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:22.004822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:22.058321 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f28b-c1f7-4c9f-bb4c-db4a4faff12d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.110645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32217951-ceb9-4abd-84ef-75d592843207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.112244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32217951-ceb9-4abd-84ef-75d592843207 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.113629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32217951-ceb9-4abd-84ef-75d592843207 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.114118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32217951-ceb9-4abd-84ef-75d592843207 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.115065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32217951-ceb9-4abd-84ef-75d592843207 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.116692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32217951-ceb9-4abd-84ef-75d592843207 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-32217951-ceb9-4abd-84ef-75d592843207 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:22.126878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:22.128906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:35:22.130114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:22.132084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 440/897] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Aug 18 20:35:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:22.139851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32217951-ceb9-4abd-84ef-75d592843207 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.148182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cf21a-d68b-4394-bd84-a6e0e098859b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.201648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a860c6-2a7a-46ec-89c6-9ed00fc277f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.202313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a860c6-2a7a-46ec-89c6-9ed00fc277f4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.202897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a860c6-2a7a-46ec-89c6-9ed00fc277f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.203184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a860c6-2a7a-46ec-89c6-9ed00fc277f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.204356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a860c6-2a7a-46ec-89c6-9ed00fc277f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:22.204655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a860c6-2a7a-46ec-89c6-9ed00fc277f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.206105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a860c6-2a7a-46ec-89c6-9ed00fc277f4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.216458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 458/898] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:22.221921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a860c6-2a7a-46ec-89c6-9ed00fc277f4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.269670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32217951-ceb9-4abd-84ef-75d592843207 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.284774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:22.308842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d8177-d84d-4920-9bbd-f7dc53f82965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.309554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:22.310084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d8177-d84d-4920-9bbd-f7dc53f82965 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.311299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d8177-d84d-4920-9bbd-f7dc53f82965 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.311790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d8177-d84d-4920-9bbd-f7dc53f82965 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.312718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d8177-d84d-4920-9bbd-f7dc53f82965 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:22.313300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d8177-d84d-4920-9bbd-f7dc53f82965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.315036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d8177-d84d-4920-9bbd-f7dc53f82965 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.322406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 441/899] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:22.328859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d8177-d84d-4920-9bbd-f7dc53f82965 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.352128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a860c6-2a7a-46ec-89c6-9ed00fc277f4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.387219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5274b-3cf2-4279-9ed8-8f11827b8fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.387863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5274b-3cf2-4279-9ed8-8f11827b8fa1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.388141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5274b-3cf2-4279-9ed8-8f11827b8fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.388414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5274b-3cf2-4279-9ed8-8f11827b8fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.400657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5274b-3cf2-4279-9ed8-8f11827b8fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.403081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5274b-3cf2-4279-9ed8-8f11827b8fa1 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-60a5274b-3cf2-4279-9ed8-8f11827b8fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:22.421571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:22.422634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:22.423668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:22.423668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:22.423668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:22.427718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 459/900] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:22.428620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5274b-3cf2-4279-9ed8-8f11827b8fa1 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.447561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d8177-d84d-4920-9bbd-f7dc53f82965 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.486486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ffb3d-cab9-4dc0-9f5d-86ec0acbc1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.487510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ffb3d-cab9-4dc0-9f5d-86ec0acbc1fb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.488036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ffb3d-cab9-4dc0-9f5d-86ec0acbc1fb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.488701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ffb3d-cab9-4dc0-9f5d-86ec0acbc1fb None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.489609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ffb3d-cab9-4dc0-9f5d-86ec0acbc1fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:22.490110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ffb3d-cab9-4dc0-9f5d-86ec0acbc1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.491933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ffb3d-cab9-4dc0-9f5d-86ec0acbc1fb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.505734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 442/901] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:22.507269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ffb3d-cab9-4dc0-9f5d-86ec0acbc1fb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.543410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5274b-3cf2-4279-9ed8-8f11827b8fa1 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.562455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:22.573456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:22.590307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6783dd5-1c88-4b67-92f2-7aefefb555fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.591530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6783dd5-1c88-4b67-92f2-7aefefb555fb None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.592052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6783dd5-1c88-4b67-92f2-7aefefb555fb None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.592930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6783dd5-1c88-4b67-92f2-7aefefb555fb None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.594013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6783dd5-1c88-4b67-92f2-7aefefb555fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:22.594474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6783dd5-1c88-4b67-92f2-7aefefb555fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.597428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6783dd5-1c88-4b67-92f2-7aefefb555fb None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.615256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 460/902] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:22.621295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6783dd5-1c88-4b67-92f2-7aefefb555fb None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.657547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ffb3d-cab9-4dc0-9f5d-86ec0acbc1fb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.703967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61afc1-9f88-45a9-adef-27e1d75785b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.704616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61afc1-9f88-45a9-adef-27e1d75785b4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.704893 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61afc1-9f88-45a9-adef-27e1d75785b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.705213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61afc1-9f88-45a9-adef-27e1d75785b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.705915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61afc1-9f88-45a9-adef-27e1d75785b4 None admin] RBAC: Adding query filter params (interface=public, service_id=0db2e3823ed94ae7a352216fc9bb8b79, region_id=RegionOne) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:22.706310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61afc1-9f88-45a9-adef-27e1d75785b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.707952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61afc1-9f88-45a9-adef-27e1d75785b4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.717703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 443/903] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Aug 18 20:35:22 2022] GET /identity/v3/endpoints?service_id=0db2e3823ed94ae7a352216fc9bb8b79&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:22.718733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61afc1-9f88-45a9-adef-27e1d75785b4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.743515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6783dd5-1c88-4b67-92f2-7aefefb555fb None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.792824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc57bd7-0446-4a1b-8a9b-32a40cbe40ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.793972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc57bd7-0446-4a1b-8a9b-32a40cbe40ce None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.795155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc57bd7-0446-4a1b-8a9b-32a40cbe40ce None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.795429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc57bd7-0446-4a1b-8a9b-32a40cbe40ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.804777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc57bd7-0446-4a1b-8a9b-32a40cbe40ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.807079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc57bd7-0446-4a1b-8a9b-32a40cbe40ce None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-5fc57bd7-0446-4a1b-8a9b-32a40cbe40ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:22.824266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:22.825239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:22.826202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:22.832957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 461/904] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:35:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:22.833939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc57bd7-0446-4a1b-8a9b-32a40cbe40ce None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.836171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61afc1-9f88-45a9-adef-27e1d75785b4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.844863 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:22.874967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:22.877457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691e97-147f-459e-85be-d629de0ffb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.878720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691e97-147f-459e-85be-d629de0ffb12 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.879353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691e97-147f-459e-85be-d629de0ffb12 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.879788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691e97-147f-459e-85be-d629de0ffb12 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.880561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691e97-147f-459e-85be-d629de0ffb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.882524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691e97-147f-459e-85be-d629de0ffb12 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.890173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 444/905] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:22 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:35:22.965268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc57bd7-0446-4a1b-8a9b-32a40cbe40ce None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:23.006760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840485c4-1dec-48a8-9348-c86c3c391aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:23.007742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840485c4-1dec-48a8-9348-c86c3c391aa5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:23.008445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840485c4-1dec-48a8-9348-c86c3c391aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:23.008879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840485c4-1dec-48a8-9348-c86c3c391aa5 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:23.009845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840485c4-1dec-48a8-9348-c86c3c391aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:23.010412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840485c4-1dec-48a8-9348-c86c3c391aa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:23.012168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840485c4-1dec-48a8-9348-c86c3c391aa5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:23.038364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 462/906] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Aug 18 20:35:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:23.044649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691e97-147f-459e-85be-d629de0ffb12 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:23.161392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691e97-147f-459e-85be-d629de0ffb12 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:23.197240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366ff4-7d7a-4a76-b9b3-5a17f2a94be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:23.197857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366ff4-7d7a-4a76-b9b3-5a17f2a94be8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:23.198138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366ff4-7d7a-4a76-b9b3-5a17f2a94be8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:23.198412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366ff4-7d7a-4a76-b9b3-5a17f2a94be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:23.243435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:23.270853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a366ff4-7d7a-4a76-b9b3-5a17f2a94be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:23.272327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a366ff4-7d7a-4a76-b9b3-5a17f2a94be8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:23.375976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 445/907] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:23 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:23.382044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840485c4-1dec-48a8-9348-c86c3c391aa5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:23.483107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:23.491183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840485c4-1dec-48a8-9348-c86c3c391aa5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:23.526178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b628b-0b49-4c10-84db-c6ba131e4655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:23.526842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b628b-0b49-4c10-84db-c6ba131e4655 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:23.527123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b628b-0b49-4c10-84db-c6ba131e4655 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:23.527393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b628b-0b49-4c10-84db-c6ba131e4655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:23.538347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b628b-0b49-4c10-84db-c6ba131e4655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:23.539870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b628b-0b49-4c10-84db-c6ba131e4655 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-e17b628b-0b49-4c10-84db-c6ba131e4655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:23.555592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:23.556625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:23.557551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:23.557551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:23.557551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:23.557551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 463/908] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:23.563442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366ff4-7d7a-4a76-b9b3-5a17f2a94be8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:23.642215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:23.676580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366ff4-7d7a-4a76-b9b3-5a17f2a94be8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:23.713368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf2393-4a31-468e-977f-7e5996aad3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:23.714038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf2393-4a31-468e-977f-7e5996aad3e6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:23.714328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf2393-4a31-468e-977f-7e5996aad3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:23.714574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf2393-4a31-468e-977f-7e5996aad3e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:23.715292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf2393-4a31-468e-977f-7e5996aad3e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:23.715585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf2393-4a31-468e-977f-7e5996aad3e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:23.716956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf2393-4a31-468e-977f-7e5996aad3e6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:23.729326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 446/909] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:23.735160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b628b-0b49-4c10-84db-c6ba131e4655 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:23.843292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b628b-0b49-4c10-84db-c6ba131e4655 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:23.880598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ca387-bb6f-4417-883e-ff9bffe81e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:23.881249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ca387-bb6f-4417-883e-ff9bffe81e05 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:23.881526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ca387-bb6f-4417-883e-ff9bffe81e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:23.881800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ca387-bb6f-4417-883e-ff9bffe81e05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:23.890233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ca387-bb6f-4417-883e-ff9bffe81e05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:23.891724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ca387-bb6f-4417-883e-ff9bffe81e05 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-753ca387-bb6f-4417-883e-ff9bffe81e05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:23.904698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:23.907247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:23.914702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:23.914702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:23.914702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:23.914702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:23.914702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:23.914702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:23.914702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:23.914702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:23.914702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 464/910] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:23.916741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf2393-4a31-468e-977f-7e5996aad3e6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:23.999625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2371-f8d0-45d4-bc52-ec083af63b0d None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:23.999992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2371-f8d0-45d4-bc52-ec083af63b0d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.000427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2371-f8d0-45d4-bc52-ec083af63b0d None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.005419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 465/911] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:24.007930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376025-850f-4a80-9d32-824caacb8f10 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.008463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376025-850f-4a80-9d32-824caacb8f10 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.008840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376025-850f-4a80-9d32-824caacb8f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.025645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:24.027127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf2393-4a31-468e-977f-7e5996aad3e6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:24.028821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a4376025-850f-4a80-9d32-824caacb8f10 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:24.030228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a4376025-850f-4a80-9d32-824caacb8f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:24.057666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:24.064981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aa32c-b276-418d-b0bf-2853010a1418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:24.065619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aa32c-b276-418d-b0bf-2853010a1418 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.065949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aa32c-b276-418d-b0bf-2853010a1418 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.066225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aa32c-b276-418d-b0bf-2853010a1418 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.067056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84aa32c-b276-418d-b0bf-2853010a1418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:24.067360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84aa32c-b276-418d-b0bf-2853010a1418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:24.068910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84aa32c-b276-418d-b0bf-2853010a1418 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:24.082113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 447/912] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:24.088813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aa32c-b276-418d-b0bf-2853010a1418 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:24.131497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 466/913] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:24.206660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aa32c-b276-418d-b0bf-2853010a1418 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:24.246526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ebbc1-8dce-408f-a3c3-ae3ade4fcc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:24.247526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ebbc1-8dce-408f-a3c3-ae3ade4fcc0d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.248038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ebbc1-8dce-408f-a3c3-ae3ade4fcc0d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.248503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ebbc1-8dce-408f-a3c3-ae3ade4fcc0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.249445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ebbc1-8dce-408f-a3c3-ae3ade4fcc0d None admin] RBAC: Adding query filter params (role.id=c798b7c9ae25488d8324caed1ed4a055, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=18429472ab6b403ea10105bf9239ce21) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:24.250015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ebbc1-8dce-408f-a3c3-ae3ade4fcc0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:24.251670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ebbc1-8dce-408f-a3c3-ae3ade4fcc0d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:24.258396 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 448/914] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:24 2022] GET /identity/v3/role_assignments?user.id=18429472ab6b403ea10105bf9239ce21&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=c798b7c9ae25488d8324caed1ed4a055 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:24.414831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376025-850f-4a80-9d32-824caacb8f10 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:24.526957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376025-850f-4a80-9d32-824caacb8f10 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:24.568544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15170d9e-ef87-4c09-8efa-bd112ce1a138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:24.569595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15170d9e-ef87-4c09-8efa-bd112ce1a138 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.570075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15170d9e-ef87-4c09-8efa-bd112ce1a138 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.570556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15170d9e-ef87-4c09-8efa-bd112ce1a138 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.571383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15170d9e-ef87-4c09-8efa-bd112ce1a138 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:24.574114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15170d9e-ef87-4c09-8efa-bd112ce1a138 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:24.577681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-15170d9e-ef87-4c09-8efa-bd112ce1a138 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:24.587921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:24.589011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:35:24.589878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:24.593011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 467/915] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:35:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:24.604438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ebbc1-8dce-408f-a3c3-ae3ade4fcc0d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:24.671109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:24.727154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ebbc1-8dce-408f-a3c3-ae3ade4fcc0d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:24.769884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b5e7f-89dc-4b0d-956d-3ff12b1e6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:24.770509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b5e7f-89dc-4b0d-956d-3ff12b1e6861 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.770824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b5e7f-89dc-4b0d-956d-3ff12b1e6861 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.771085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b5e7f-89dc-4b0d-956d-3ff12b1e6861 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.771728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b5e7f-89dc-4b0d-956d-3ff12b1e6861 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:24.772032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b5e7f-89dc-4b0d-956d-3ff12b1e6861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:24.773419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b5e7f-89dc-4b0d-956d-3ff12b1e6861 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:24.779231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 449/916] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:35:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:24.785155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b74234-286f-44af-91fd-bab51487b270 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.785155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b74234-286f-44af-91fd-bab51487b270 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.785155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b74234-286f-44af-91fd-bab51487b270 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.786558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b5e7f-89dc-4b0d-956d-3ff12b1e6861 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:24.786811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 468/917] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:24.793056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70dcf9-88df-47c6-bf17-627778ae5014 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.793632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70dcf9-88df-47c6-bf17-627778ae5014 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.794131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70dcf9-88df-47c6-bf17-627778ae5014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.815037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1b70dcf9-88df-47c6-bf17-627778ae5014 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:24.817178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1b70dcf9-88df-47c6-bf17-627778ae5014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:24.919053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 469/918] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:24.928217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b5e7f-89dc-4b0d-956d-3ff12b1e6861 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:24.949529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:24.970442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c776d-0a41-4177-aed3-9aac3bd522de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:24.971099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c776d-0a41-4177-aed3-9aac3bd522de None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.971380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c776d-0a41-4177-aed3-9aac3bd522de None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.971652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c776d-0a41-4177-aed3-9aac3bd522de None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.972869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c776d-0a41-4177-aed3-9aac3bd522de None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:24.973182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c776d-0a41-4177-aed3-9aac3bd522de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:24.974574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c776d-0a41-4177-aed3-9aac3bd522de None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:24.986003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 450/919] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Aug 18 20:35:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:24.987334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70dcf9-88df-47c6-bf17-627778ae5014 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.084555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ef98a-9602-4968-ac89-881c066dcdfb None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.084889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ef98a-9602-4968-ac89-881c066dcdfb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.085284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ef98a-9602-4968-ac89-881c066dcdfb None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.087873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 451/920] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:25.094478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da42d25-7b0f-4059-8507-10ee8022c6fe None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.094808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da42d25-7b0f-4059-8507-10ee8022c6fe None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.095057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da42d25-7b0f-4059-8507-10ee8022c6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.115304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7da42d25-7b0f-4059-8507-10ee8022c6fe None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:25.116273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70dcf9-88df-47c6-bf17-627778ae5014 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.116487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7da42d25-7b0f-4059-8507-10ee8022c6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:25.156086 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:25.163710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0baf0d-9bfc-4915-b2eb-d3110075c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.165182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0baf0d-9bfc-4915-b2eb-d3110075c934 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.165182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0baf0d-9bfc-4915-b2eb-d3110075c934 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.165182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0baf0d-9bfc-4915-b2eb-d3110075c934 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.165666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0baf0d-9bfc-4915-b2eb-d3110075c934 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.166991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0baf0d-9bfc-4915-b2eb-d3110075c934 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.194815 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 470/921] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:25.221042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0baf0d-9bfc-4915-b2eb-d3110075c934 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.227463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 452/922] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:25.346383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0baf0d-9bfc-4915-b2eb-d3110075c934 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.384719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c110a1-e619-4a76-9c96-25cde89dfcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.385655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c110a1-e619-4a76-9c96-25cde89dfcb0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.386082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c110a1-e619-4a76-9c96-25cde89dfcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.386547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c110a1-e619-4a76-9c96-25cde89dfcb0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.387333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c110a1-e619-4a76-9c96-25cde89dfcb0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.388913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c110a1-e619-4a76-9c96-25cde89dfcb0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-e8c110a1-e619-4a76-9c96-25cde89dfcb0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:25.399705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:25.400880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:25.401757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:25.402507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 471/923] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:25.407591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da42d25-7b0f-4059-8507-10ee8022c6fe None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.521272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da42d25-7b0f-4059-8507-10ee8022c6fe None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.531063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:25.557165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce711be-0b5c-4a1d-a61b-0f28b7f3df7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.557791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce711be-0b5c-4a1d-a61b-0f28b7f3df7c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.558070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce711be-0b5c-4a1d-a61b-0f28b7f3df7c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.558340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce711be-0b5c-4a1d-a61b-0f28b7f3df7c None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.559009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce711be-0b5c-4a1d-a61b-0f28b7f3df7c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:25.559315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce711be-0b5c-4a1d-a61b-0f28b7f3df7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.560713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce711be-0b5c-4a1d-a61b-0f28b7f3df7c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.567071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 453/924] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:25.568152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c110a1-e619-4a76-9c96-25cde89dfcb0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.572645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce711be-0b5c-4a1d-a61b-0f28b7f3df7c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.626828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:25.684085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c110a1-e619-4a76-9c96-25cde89dfcb0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.720175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce711be-0b5c-4a1d-a61b-0f28b7f3df7c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.731130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601a09b-eaff-44bf-b588-021e4c0f3c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.731902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a09b-eaff-44bf-b588-021e4c0f3c94 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.732253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a09b-eaff-44bf-b588-021e4c0f3c94 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.732596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a09b-eaff-44bf-b588-021e4c0f3c94 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.733686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601a09b-eaff-44bf-b588-021e4c0f3c94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.735531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601a09b-eaff-44bf-b588-021e4c0f3c94 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-b601a09b-eaff-44bf-b588-021e4c0f3c94 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:25.748358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:25.749376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:25.755941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 472/925] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:25.757689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601a09b-eaff-44bf-b588-021e4c0f3c94 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.767868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4461b7-47b4-4229-8199-bee673010dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.768486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4461b7-47b4-4229-8199-bee673010dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.769529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4461b7-47b4-4229-8199-bee673010dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.769877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4461b7-47b4-4229-8199-bee673010dc8 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.770524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4461b7-47b4-4229-8199-bee673010dc8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:25.770855 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4461b7-47b4-4229-8199-bee673010dc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.772367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4461b7-47b4-4229-8199-bee673010dc8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.778578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 454/926] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:25.784243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4461b7-47b4-4229-8199-bee673010dc8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.832767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:25.886454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601a09b-eaff-44bf-b588-021e4c0f3c94 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.904446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:25.907436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4461b7-47b4-4229-8199-bee673010dc8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.934596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1ea4-9fd1-4015-8260-745bf695cd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.935801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1ea4-9fd1-4015-8260-745bf695cd51 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.936297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1ea4-9fd1-4015-8260-745bf695cd51 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.936778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1ea4-9fd1-4015-8260-745bf695cd51 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.937616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb1ea4-9fd1-4015-8260-745bf695cd51 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:25.938214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb1ea4-9fd1-4015-8260-745bf695cd51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.939937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb1ea4-9fd1-4015-8260-745bf695cd51 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.944935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b885245-10ff-42f3-903a-b929ee1e939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.945549 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885245-10ff-42f3-903a-b929ee1e939e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.945828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885245-10ff-42f3-903a-b929ee1e939e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.946099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885245-10ff-42f3-903a-b929ee1e939e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.946817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b885245-10ff-42f3-903a-b929ee1e939e None admin] RBAC: Adding query filter params (interface=public, service_id=908a266615794f2eb71829cf5fea175b, region_id=RegionOne) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:25.947129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b885245-10ff-42f3-903a-b929ee1e939e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.948493 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b885245-10ff-42f3-903a-b929ee1e939e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.953969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 473/927] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:25.955151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1ea4-9fd1-4015-8260-745bf695cd51 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.958836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 455/928] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/endpoints?service_id=908a266615794f2eb71829cf5fea175b&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:25.959705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b885245-10ff-42f3-903a-b929ee1e939e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:26.061700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:26.064687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b885245-10ff-42f3-903a-b929ee1e939e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:26.080940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1ea4-9fd1-4015-8260-745bf695cd51 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:26.101377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07639b37-f0a3-4fa9-bfc9-a18c249b10c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:26.102209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07639b37-f0a3-4fa9-bfc9-a18c249b10c0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:26.102496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07639b37-f0a3-4fa9-bfc9-a18c249b10c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:26.102903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07639b37-f0a3-4fa9-bfc9-a18c249b10c0 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:26.103608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07639b37-f0a3-4fa9-bfc9-a18c249b10c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:26.105188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07639b37-f0a3-4fa9-bfc9-a18c249b10c0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:26.119471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 456/929] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:35:26.126559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe67a86-3884-40d0-ae1a-8b5f3e65f00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:26.127477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe67a86-3884-40d0-ae1a-8b5f3e65f00d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:26.128453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe67a86-3884-40d0-ae1a-8b5f3e65f00d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:26.129585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe67a86-3884-40d0-ae1a-8b5f3e65f00d None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:26.130569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe67a86-3884-40d0-ae1a-8b5f3e65f00d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:26.131058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe67a86-3884-40d0-ae1a-8b5f3e65f00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:26.132653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe67a86-3884-40d0-ae1a-8b5f3e65f00d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:26.139538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 474/930] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:26.146440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07639b37-f0a3-4fa9-bfc9-a18c249b10c0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:26.272196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07639b37-f0a3-4fa9-bfc9-a18c249b10c0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:26.309241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98aa71-cdc5-4cf4-ba64-0f8de0b86814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:26.309857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98aa71-cdc5-4cf4-ba64-0f8de0b86814 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:26.310138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98aa71-cdc5-4cf4-ba64-0f8de0b86814 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:26.310467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98aa71-cdc5-4cf4-ba64-0f8de0b86814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:26.311232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98aa71-cdc5-4cf4-ba64-0f8de0b86814 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:26.312539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993af494-89ed-41ec-9004-f12d41d2dabc None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:26.312647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98aa71-cdc5-4cf4-ba64-0f8de0b86814 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:26.312818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993af494-89ed-41ec-9004-f12d41d2dabc None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:26.313090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993af494-89ed-41ec-9004-f12d41d2dabc None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:26.314557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 475/931] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:26.320680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc85f5-556f-4436-b9c9-6ca09e56b13f None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:26.321118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc85f5-556f-4436-b9c9-6ca09e56b13f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:26.321577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc85f5-556f-4436-b9c9-6ca09e56b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:26.338380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 457/932] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:26.344177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e2fc85f5-556f-4436-b9c9-6ca09e56b13f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:26.345442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e2fc85f5-556f-4436-b9c9-6ca09e56b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:26.396669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:26.454981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 476/933] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:26.756502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98aa71-cdc5-4cf4-ba64-0f8de0b86814 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:26.782690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:26.872811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98aa71-cdc5-4cf4-ba64-0f8de0b86814 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:26.911850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15dd2b-b9ec-4655-a207-2af37a68e851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:26.912880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15dd2b-b9ec-4655-a207-2af37a68e851 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:26.913367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15dd2b-b9ec-4655-a207-2af37a68e851 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:26.913873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15dd2b-b9ec-4655-a207-2af37a68e851 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:26.924717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15dd2b-b9ec-4655-a207-2af37a68e851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-7b15dd2b-b9ec-4655-a207-2af37a68e851 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:26.930930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:26.931944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:26.932831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:26.940114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 458/934] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Aug 18 20:35:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:26.942324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc85f5-556f-4436-b9c9-6ca09e56b13f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:27.054879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc85f5-556f-4436-b9c9-6ca09e56b13f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:27.092717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7166e-38a4-48e5-8037-32a9f695582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:27.093329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7166e-38a4-48e5-8037-32a9f695582d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.093606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7166e-38a4-48e5-8037-32a9f695582d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.093876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7166e-38a4-48e5-8037-32a9f695582d None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.094542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7166e-38a4-48e5-8037-32a9f695582d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:27.098210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7166e-38a4-48e5-8037-32a9f695582d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:27.098210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7166e-38a4-48e5-8037-32a9f695582d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:27.106134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 477/935] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:27.111720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15dd2b-b9ec-4655-a207-2af37a68e851 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:27.211182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:27.224924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15dd2b-b9ec-4655-a207-2af37a68e851 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:27.262077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c48563-055b-4539-8585-f2633fade46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:27.262722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c48563-055b-4539-8585-f2633fade46c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.263027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c48563-055b-4539-8585-f2633fade46c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.263399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c48563-055b-4539-8585-f2633fade46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.265049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c208e-6e38-4184-b805-6623be43df6e None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.265334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c208e-6e38-4184-b805-6623be43df6e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.265603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c208e-6e38-4184-b805-6623be43df6e None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.267332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 478/936] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:27.279079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bd7d3-3072-48d1-8d99-dd55941d3684 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.279491 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bd7d3-3072-48d1-8d99-dd55941d3684 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.279893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bd7d3-3072-48d1-8d99-dd55941d3684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.282544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c48563-055b-4539-8585-f2633fade46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:27.284052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c48563-055b-4539-8585-f2633fade46c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:27.299506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ee7bd7d3-3072-48d1-8d99-dd55941d3684 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e3c48563-055b-4539-8585-f2633fade46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:27.299777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:27.301712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:27.303034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:27.303034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:27.303034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:27.303034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 459/937] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:27.305925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ee7bd7d3-3072-48d1-8d99-dd55941d3684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:27.307590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c48563-055b-4539-8585-f2633fade46c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:27.340428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:27.398894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 479/938] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:27.429489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c48563-055b-4539-8585-f2633fade46c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:27.467109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:27.473398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3fe1c-2adc-4069-a6eb-b261219bc4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:27.474258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3fe1c-2adc-4069-a6eb-b261219bc4d6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.474790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3fe1c-2adc-4069-a6eb-b261219bc4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.475265 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3fe1c-2adc-4069-a6eb-b261219bc4d6 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.476124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3fe1c-2adc-4069-a6eb-b261219bc4d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:27.476645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3fe1c-2adc-4069-a6eb-b261219bc4d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:27.478224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3fe1c-2adc-4069-a6eb-b261219bc4d6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:27.496230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 460/939] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:27.497861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bd7d3-3072-48d1-8d99-dd55941d3684 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:27.606126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bd7d3-3072-48d1-8d99-dd55941d3684 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:27.641192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94e944-361f-4e65-9ea3-3ea0e3024b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:27.641831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94e944-361f-4e65-9ea3-3ea0e3024b4f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.642109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94e944-361f-4e65-9ea3-3ea0e3024b4f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.642379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94e944-361f-4e65-9ea3-3ea0e3024b4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.650419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94e944-361f-4e65-9ea3-3ea0e3024b4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:27.651885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94e944-361f-4e65-9ea3-3ea0e3024b4f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-4e94e944-361f-4e65-9ea3-3ea0e3024b4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:27.664322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:27.665307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:27.666886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 480/940] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:35:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:27.671198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3fe1c-2adc-4069-a6eb-b261219bc4d6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:27.686500 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94e944-361f-4e65-9ea3-3ea0e3024b4f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:27.711122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:27.782987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3fe1c-2adc-4069-a6eb-b261219bc4d6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:27.799014 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94e944-361f-4e65-9ea3-3ea0e3024b4f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:27.820101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07bf71-cf68-4862-baf6-989a71dbfc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:27.820718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07bf71-cf68-4862-baf6-989a71dbfc43 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.821003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07bf71-cf68-4862-baf6-989a71dbfc43 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.821334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07bf71-cf68-4862-baf6-989a71dbfc43 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.822078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07bf71-cf68-4862-baf6-989a71dbfc43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:27.822386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07bf71-cf68-4862-baf6-989a71dbfc43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:27.823865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07bf71-cf68-4862-baf6-989a71dbfc43 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:27.835498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:27.836117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.836396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.836668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.837323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:27.838919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:27.841581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WARNING keystone.server.flask.common [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 20:35:27.842634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 461/941] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Aug 18 20:35:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:27.849027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07bf71-cf68-4862-baf6-989a71dbfc43 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:27.870215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.sql.core [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:35:27.870215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 20:35:27.870215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [parameters: {'id': 'e7d2c2344335408098d2b47c2c7cf2c8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 20:35:27.870215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e7d2c2344335408098d2b47c2c7cf2c8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e7d2c2344335408098d2b47c2c7cf2c8. Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:35:27.881021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result.read() Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 20:35:27.881946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application yield resource Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise self.value Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application session.commit() Aug 18 20:35:27.882972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:35:27.884169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:35:27.885107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result.read() Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:35:27.885975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [parameters: {'id': 'e7d2c2344335408098d2b47c2c7cf2c8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:27.888114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:27.890046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e7d2c2344335408098d2b47c2c7cf2c8. Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 481/942] 10.222.0.65 () {60 vars in 1140 bytes} [Thu Aug 18 20:35:27 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:27.892262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:27.930589 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:28.002905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07bf71-cf68-4862-baf6-989a71dbfc43 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.005439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:28.031933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce213a5-90f1-4dd5-af82-7a2bdbad2f50 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.045531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816b57c-4589-4bde-b732-0bc5c3d10126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.046175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816b57c-4589-4bde-b732-0bc5c3d10126 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.046674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816b57c-4589-4bde-b732-0bc5c3d10126 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.046984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816b57c-4589-4bde-b732-0bc5c3d10126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.060860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816b57c-4589-4bde-b732-0bc5c3d10126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.062538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816b57c-4589-4bde-b732-0bc5c3d10126 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.071507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f5544-db99-4132-bb7b-6028fc2cdc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.072478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5544-db99-4132-bb7b-6028fc2cdc71 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.072972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5544-db99-4132-bb7b-6028fc2cdc71 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.073485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5544-db99-4132-bb7b-6028fc2cdc71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-0816b57c-4589-4bde-b732-0bc5c3d10126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:28.079113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:28.080098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:28.081196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:28.081196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:28.081196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:28.083886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f5544-db99-4132-bb7b-6028fc2cdc71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.085760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 462/943] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:28.086096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f5544-db99-4132-bb7b-6028fc2cdc71 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.086666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816b57c-4589-4bde-b732-0bc5c3d10126 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-7b6f5544-db99-4132-bb7b-6028fc2cdc71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:28.099755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:28.100727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:28.101625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:28.101625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:28.101625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:28.101625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:28.101625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:28.101625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:28.101625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:28.101625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:28.104201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 482/944] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:28.110542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f5544-db99-4132-bb7b-6028fc2cdc71 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.211949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816b57c-4589-4bde-b732-0bc5c3d10126 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.213602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:28.241784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f5544-db99-4132-bb7b-6028fc2cdc71 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.250083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a7afb-4782-48f8-bc9f-9e1cb7231dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.250689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a7afb-4782-48f8-bc9f-9e1cb7231dbc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.251008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a7afb-4782-48f8-bc9f-9e1cb7231dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.251279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a7afb-4782-48f8-bc9f-9e1cb7231dbc None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.251937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a7afb-4782-48f8-bc9f-9e1cb7231dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:28.252242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a7afb-4782-48f8-bc9f-9e1cb7231dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.254200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a7afb-4782-48f8-bc9f-9e1cb7231dbc None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.268584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 463/945] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:28.271157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced7d8d-5cc0-4852-ae8a-96843c0a1aae None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.271561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced7d8d-5cc0-4852-ae8a-96843c0a1aae None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.271939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced7d8d-5cc0-4852-ae8a-96843c0a1aae None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.274222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 464/946] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:28.275601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced7d8d-5cc0-4852-ae8a-96843c0a1aae None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.283328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369ecc9-6910-49a6-ad41-86353d2ac056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.283934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369ecc9-6910-49a6-ad41-86353d2ac056 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.284418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369ecc9-6910-49a6-ad41-86353d2ac056 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.284706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369ecc9-6910-49a6-ad41-86353d2ac056 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.285372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369ecc9-6910-49a6-ad41-86353d2ac056 None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:28.285670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369ecc9-6910-49a6-ad41-86353d2ac056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.287110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369ecc9-6910-49a6-ad41-86353d2ac056 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.291191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:28.309263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 483/947] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:28.311099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546a99a-7294-4594-82c3-c862105829a0 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.311434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546a99a-7294-4594-82c3-c862105829a0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.311713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546a99a-7294-4594-82c3-c862105829a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.332446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3546a99a-7294-4594-82c3-c862105829a0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:28.334225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3546a99a-7294-4594-82c3-c862105829a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:28.416724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced7d8d-5cc0-4852-ae8a-96843c0a1aae None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.437653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 484/948] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:28.439415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8eb7f-9672-4865-81f6-1e0c31c4b8bf None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.439683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8eb7f-9672-4865-81f6-1e0c31c4b8bf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.439958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8eb7f-9672-4865-81f6-1e0c31c4b8bf None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.441381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 485/949] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:28.447225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575a7f0-bc79-466a-b463-d8be010bec9e None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.447789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575a7f0-bc79-466a-b463-d8be010bec9e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.448239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575a7f0-bc79-466a-b463-d8be010bec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.463778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386ce7b-fc0f-4e82-9d05-0eff73fd2653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.464576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386ce7b-fc0f-4e82-9d05-0eff73fd2653 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.464970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386ce7b-fc0f-4e82-9d05-0eff73fd2653 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.465279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386ce7b-fc0f-4e82-9d05-0eff73fd2653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.469227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3575a7f0-bc79-466a-b463-d8be010bec9e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:28.470665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3575a7f0-bc79-466a-b463-d8be010bec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:28.475315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386ce7b-fc0f-4e82-9d05-0eff73fd2653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.476690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386ce7b-fc0f-4e82-9d05-0eff73fd2653 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1386ce7b-fc0f-4e82-9d05-0eff73fd2653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:28.492014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:28.493191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:28.494313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:28.494313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:28.494313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:28.494313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:28.494313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:28.494313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:28.494313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:28.494313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:28.494894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 465/950] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:28.500557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386ce7b-fc0f-4e82-9d05-0eff73fd2653 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.533252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:28.557173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 486/951] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:28.635832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386ce7b-fc0f-4e82-9d05-0eff73fd2653 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.672782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced2d00-1292-40e0-8ef6-5eba388aae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.673316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced2d00-1292-40e0-8ef6-5eba388aae11 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.673606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced2d00-1292-40e0-8ef6-5eba388aae11 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.673948 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced2d00-1292-40e0-8ef6-5eba388aae11 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.674695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced2d00-1292-40e0-8ef6-5eba388aae11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:28.675040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced2d00-1292-40e0-8ef6-5eba388aae11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.676713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced2d00-1292-40e0-8ef6-5eba388aae11 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.689878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 466/952] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:28.696172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575a7f0-bc79-466a-b463-d8be010bec9e None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.745001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced2d00-1292-40e0-8ef6-5eba388aae11 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.767995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:28.807355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575a7f0-bc79-466a-b463-d8be010bec9e None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.835355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:28.848144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7702-81ce-4273-9dad-9b8d2f3164ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.848818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7702-81ce-4273-9dad-9b8d2f3164ea None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.849099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7702-81ce-4273-9dad-9b8d2f3164ea None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.849370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7702-81ce-4273-9dad-9b8d2f3164ea None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/18429472ab6b403ea10105bf9239ce21/roles/c798b7c9ae25488d8324caed1ed4a055` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.851964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef7702-81ce-4273-9dad-9b8d2f3164ea None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=18429472ab6b403ea10105bf9239ce21, role_id=c798b7c9ae25488d8324caed1ed4a055)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.853403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef7702-81ce-4273-9dad-9b8d2f3164ea None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.858319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced2d00-1292-40e0-8ef6-5eba388aae11 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.868368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 487/953] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:28 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/18429472ab6b403ea10105bf9239ce21/roles/c798b7c9ae25488d8324caed1ed4a055 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:35:28.875773 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7702-81ce-4273-9dad-9b8d2f3164ea None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.908777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c417-06f1-4989-9845-2d2e0e2763aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.909918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c417-06f1-4989-9845-2d2e0e2763aa None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.910426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c417-06f1-4989-9845-2d2e0e2763aa None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.911106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c417-06f1-4989-9845-2d2e0e2763aa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.912082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24c417-06f1-4989-9845-2d2e0e2763aa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.913887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24c417-06f1-4989-9845-2d2e0e2763aa None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ec24c417-06f1-4989-9845-2d2e0e2763aa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:28.925330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:28.926429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:28.927928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:28.930837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 467/954] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:28.939369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c417-06f1-4989-9845-2d2e0e2763aa None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:29.038977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7702-81ce-4273-9dad-9b8d2f3164ea None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:29.064846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:29.087902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858f488-450d-421a-baeb-8ec7aed4927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:29.088788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858f488-450d-421a-baeb-8ec7aed4927c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:29.089214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858f488-450d-421a-baeb-8ec7aed4927c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:29.089352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c417-06f1-4989-9845-2d2e0e2763aa None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:29.089755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858f488-450d-421a-baeb-8ec7aed4927c None admin] PATH_INFO: `/v3/services/compute` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:29.090499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858f488-450d-421a-baeb-8ec7aed4927c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:29.093260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858f488-450d-421a-baeb-8ec7aed4927c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-0858f488-450d-421a-baeb-8ec7aed4927c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:29.107163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:29.108502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:29.109599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:29.113525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 488/955] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:29.120075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858f488-450d-421a-baeb-8ec7aed4927c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:29.134850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b521-ba9b-45ee-beb7-1bc3e7c07e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:29.135778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b521-ba9b-45ee-beb7-1bc3e7c07e60 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:29.136233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b521-ba9b-45ee-beb7-1bc3e7c07e60 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:29.136698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b521-ba9b-45ee-beb7-1bc3e7c07e60 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:29.137483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07b521-ba9b-45ee-beb7-1bc3e7c07e60 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:29.137978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07b521-ba9b-45ee-beb7-1bc3e7c07e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:29.139585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07b521-ba9b-45ee-beb7-1bc3e7c07e60 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:29.150378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 468/956] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:29.160717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b521-ba9b-45ee-beb7-1bc3e7c07e60 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:29.201471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:29.256556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858f488-450d-421a-baeb-8ec7aed4927c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:29.295879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e39d-6695-4a67-91e1-44b8b0f7b53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:29.296777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e39d-6695-4a67-91e1-44b8b0f7b53f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:29.297204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e39d-6695-4a67-91e1-44b8b0f7b53f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:29.297624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e39d-6695-4a67-91e1-44b8b0f7b53f None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:29.298463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459e39d-6695-4a67-91e1-44b8b0f7b53f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:29.298988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459e39d-6695-4a67-91e1-44b8b0f7b53f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:29.300540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459e39d-6695-4a67-91e1-44b8b0f7b53f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:29.301880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b521-ba9b-45ee-beb7-1bc3e7c07e60 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:29.306922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 489/957] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:29.317606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e39d-6695-4a67-91e1-44b8b0f7b53f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:29.340536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cfa85-9fd3-4b7e-9de0-92ef4f4b1b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:29.341419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cfa85-9fd3-4b7e-9de0-92ef4f4b1b92 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:29.341765 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cfa85-9fd3-4b7e-9de0-92ef4f4b1b92 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:29.342137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cfa85-9fd3-4b7e-9de0-92ef4f4b1b92 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:29.342906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cfa85-9fd3-4b7e-9de0-92ef4f4b1b92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:29.343309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cfa85-9fd3-4b7e-9de0-92ef4f4b1b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:29.344843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cfa85-9fd3-4b7e-9de0-92ef4f4b1b92 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:29.350950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 469/958] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:29.359912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cfa85-9fd3-4b7e-9de0-92ef4f4b1b92 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:29.378640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:29.442073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e39d-6695-4a67-91e1-44b8b0f7b53f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:29.469387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:29.481917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ab623-d3fc-4c21-a877-f341f98baa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:29.483034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ab623-d3fc-4c21-a877-f341f98baa6c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:29.483555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ab623-d3fc-4c21-a877-f341f98baa6c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:29.484030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ab623-d3fc-4c21-a877-f341f98baa6c None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:29.484863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ab623-d3fc-4c21-a877-f341f98baa6c None admin] RBAC: Adding query filter params (type=compute) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:29.485380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ab623-d3fc-4c21-a877-f341f98baa6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:29.486987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ab623-d3fc-4c21-a877-f341f98baa6c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:29.492908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 490/959] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:29.503656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cfa85-9fd3-4b7e-9de0-92ef4f4b1b92 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:29.542836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aced79-a053-401c-9540-622c0485975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:29.543482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aced79-a053-401c-9540-622c0485975f None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:29.543761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aced79-a053-401c-9540-622c0485975f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:29.544025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aced79-a053-401c-9540-622c0485975f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:29.544714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aced79-a053-401c-9540-622c0485975f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:29.546170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aced79-a053-401c-9540-622c0485975f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:29.585832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 470/960] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:35:30.488142 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2833a-dca0-4ac3-aa91-b7fe9dbc1619 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:30.488719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2833a-dca0-4ac3-aa91-b7fe9dbc1619 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:30.488719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2833a-dca0-4ac3-aa91-b7fe9dbc1619 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:30.490330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 491/961] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:30.495854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7564c-2087-47ca-885d-a3f321c8d874 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:30.496273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7564c-2087-47ca-885d-a3f321c8d874 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:30.496446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7564c-2087-47ca-885d-a3f321c8d874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:30.515597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-41f7564c-2087-47ca-885d-a3f321c8d874 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:30.516804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-41f7564c-2087-47ca-885d-a3f321c8d874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:30.614550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 471/962] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:30.883368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc69de-1346-4bfa-8009-e4715b1559aa None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:30.883710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc69de-1346-4bfa-8009-e4715b1559aa None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:30.883887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc69de-1346-4bfa-8009-e4715b1559aa None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:30.885483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 492/963] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:30.891432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc69de-1346-4bfa-8009-e4715b1559aa None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:30.891586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775b420-69c2-41cb-b315-2c7d92853b34 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:30.891866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775b420-69c2-41cb-b315-2c7d92853b34 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:30.892053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775b420-69c2-41cb-b315-2c7d92853b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:30.915668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f775b420-69c2-41cb-b315-2c7d92853b34 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:30.917655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f775b420-69c2-41cb-b315-2c7d92853b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:30.986523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.008541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc69de-1346-4bfa-8009-e4715b1559aa None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.019407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 472/964] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:31.023629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.050401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.051204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.051494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.051823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.052476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.054030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.071218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.sql.core [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:35:31.071218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 20:35:31.071218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [parameters: {'user_id': '3e3c4995ea734c2eb1ae7b8308b41f0f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 20:35:31.071218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result.read() Aug 18 20:35:31.078813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:35:31.079764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application yield resource Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise self.value Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application session.commit() Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:35:31.080784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:35:31.082588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:35:31.084889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application result.read() Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:35:31.087159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [parameters: {'user_id': '3e3c4995ea734c2eb1ae7b8308b41f0f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:31.089598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 20:35:31.095359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 20:35:31.096318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 20:35:31.096318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 20:35:31.096318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:35:31.096318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:35:31.096318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 20:35:31.096318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:31.096318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 493/965] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Aug 18 20:35:30 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:31.097258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775b420-69c2-41cb-b315-2c7d92853b34 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.213930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775b420-69c2-41cb-b315-2c7d92853b34 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.252241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b885e7-7d8a-432b-968b-d3aec4b7e1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.253690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b885e7-7d8a-432b-968b-d3aec4b7e1aa None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.254120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b885e7-7d8a-432b-968b-d3aec4b7e1aa None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.254539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b885e7-7d8a-432b-968b-d3aec4b7e1aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.262703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b885e7-7d8a-432b-968b-d3aec4b7e1aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.264378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b885e7-7d8a-432b-968b-d3aec4b7e1aa None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-07b885e7-7d8a-432b-968b-d3aec4b7e1aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:31.276959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:31.278159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:35:31.279404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:31.281622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 473/966] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:31.288496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.320963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b885e7-7d8a-432b-968b-d3aec4b7e1aa None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.376994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.425726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d97317-4af7-418e-8c5b-993e56721af7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.439488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b885e7-7d8a-432b-968b-d3aec4b7e1aa None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.468051 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfd892-2886-4f85-af02-0eab11d32bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.468980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfd892-2886-4f85-af02-0eab11d32bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.469457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfd892-2886-4f85-af02-0eab11d32bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.469807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfd892-2886-4f85-af02-0eab11d32bf5 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.472381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfd892-2886-4f85-af02-0eab11d32bf5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:31.472825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfd892-2886-4f85-af02-0eab11d32bf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.474537 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfd892-2886-4f85-af02-0eab11d32bf5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.480659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038afc0-6d6e-4337-bbb4-12d136525fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.481291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038afc0-6d6e-4337-bbb4-12d136525fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.481566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038afc0-6d6e-4337-bbb4-12d136525fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.481836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038afc0-6d6e-4337-bbb4-12d136525fe6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.492806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038afc0-6d6e-4337-bbb4-12d136525fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2038afc0-6d6e-4337-bbb4-12d136525fe6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:31.497998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:31.499685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 474/967] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:31.500762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1915-d519-4769-8349-87eaf8688be8 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.501588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1915-d519-4769-8349-87eaf8688be8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.501588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1915-d519-4769-8349-87eaf8688be8 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.506920 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 475/968] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:31.506920 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1915-d519-4769-8349-87eaf8688be8 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.526810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 494/969] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:31.526810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a686558-ba83-41ae-9836-b454cd4e1ea8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.526810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a686558-ba83-41ae-9836-b454cd4e1ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.526810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a686558-ba83-41ae-9836-b454cd4e1ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.552074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-9a686558-ba83-41ae-9836-b454cd4e1ea8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:31.553837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9a686558-ba83-41ae-9836-b454cd4e1ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:31.598785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.630892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1915-d519-4769-8349-87eaf8688be8 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.639387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.661660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 495/970] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:31.671279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf8ce1-cf49-4dc1-a4b5-da036a71fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.671908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf8ce1-cf49-4dc1-a4b5-da036a71fb27 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.672185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf8ce1-cf49-4dc1-a4b5-da036a71fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.672456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf8ce1-cf49-4dc1-a4b5-da036a71fb27 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.672561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e70c7-cf81-413a-b8f1-25ac70b995e5 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.672841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e70c7-cf81-413a-b8f1-25ac70b995e5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.673132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf8ce1-cf49-4dc1-a4b5-da036a71fb27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:31.673229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e70c7-cf81-413a-b8f1-25ac70b995e5 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.673434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf8ce1-cf49-4dc1-a4b5-da036a71fb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.675118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf8ce1-cf49-4dc1-a4b5-da036a71fb27 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.675252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 496/971] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:31.680603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff3fc9-aba4-4fca-b4a9-18b12b2a8878 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.680880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff3fc9-aba4-4fca-b4a9-18b12b2a8878 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.681152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff3fc9-aba4-4fca-b4a9-18b12b2a8878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.697909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 476/972] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:31.698502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf8ce1-cf49-4dc1-a4b5-da036a71fb27 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.708287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-bcff3fc9-aba4-4fca-b4a9-18b12b2a8878 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:31.709319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-bcff3fc9-aba4-4fca-b4a9-18b12b2a8878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:31.803936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 497/973] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:31.835115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf8ce1-cf49-4dc1-a4b5-da036a71fb27 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.878883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dfea6-749e-4af2-89af-ebea382edf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.879521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dfea6-749e-4af2-89af-ebea382edf52 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.879802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dfea6-749e-4af2-89af-ebea382edf52 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.880199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dfea6-749e-4af2-89af-ebea382edf52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.897464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dfea6-749e-4af2-89af-ebea382edf52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.898973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dfea6-749e-4af2-89af-ebea382edf52 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-4a8dfea6-749e-4af2-89af-ebea382edf52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:31.914907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:31.915910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:31.916852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:31.916852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:31.916852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:31.916852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 477/974] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:31.923387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff3fc9-aba4-4fca-b4a9-18b12b2a8878 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.938266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dfea6-749e-4af2-89af-ebea382edf52 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.964649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:32.017532 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:32.031469 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff3fc9-aba4-4fca-b4a9-18b12b2a8878 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.056220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dfea6-749e-4af2-89af-ebea382edf52 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.067318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b47fc6-3143-4414-b3ac-d3dddc262eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.067934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47fc6-3143-4414-b3ac-d3dddc262eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.068217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47fc6-3143-4414-b3ac-d3dddc262eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.068484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47fc6-3143-4414-b3ac-d3dddc262eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.069127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b47fc6-3143-4414-b3ac-d3dddc262eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:32.069422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b47fc6-3143-4414-b3ac-d3dddc262eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.070791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b47fc6-3143-4414-b3ac-d3dddc262eb4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.083178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 498/975] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:32.084098 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b47fc6-3143-4414-b3ac-d3dddc262eb4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:32.099748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99f4a-ebfc-48d9-bb31-452903f8723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.100364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99f4a-ebfc-48d9-bb31-452903f8723e None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.100628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99f4a-ebfc-48d9-bb31-452903f8723e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.100897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99f4a-ebfc-48d9-bb31-452903f8723e None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.101534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99f4a-ebfc-48d9-bb31-452903f8723e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.102915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99f4a-ebfc-48d9-bb31-452903f8723e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.117986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 478/976] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:31 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:32.119741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99f4a-ebfc-48d9-bb31-452903f8723e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:32.208868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b47fc6-3143-4414-b3ac-d3dddc262eb4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.233531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:32.258947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa31e85-0e74-4419-a643-9000620db02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.259599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa31e85-0e74-4419-a643-9000620db02d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.259879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa31e85-0e74-4419-a643-9000620db02d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.260152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa31e85-0e74-4419-a643-9000620db02d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.260747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa31e85-0e74-4419-a643-9000620db02d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.261442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99f4a-ebfc-48d9-bb31-452903f8723e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.262127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa31e85-0e74-4419-a643-9000620db02d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-baa31e85-0e74-4419-a643-9000620db02d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:32.273446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:32.274728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:32.275744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 499/977] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:32.282573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa31e85-0e74-4419-a643-9000620db02d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:32.296491 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:32.305714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4913473-9bcb-4d18-b972-41626bf81e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.306431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4913473-9bcb-4d18-b972-41626bf81e9f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.306635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4913473-9bcb-4d18-b972-41626bf81e9f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.306935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4913473-9bcb-4d18-b972-41626bf81e9f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.316020 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4913473-9bcb-4d18-b972-41626bf81e9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.317488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4913473-9bcb-4d18-b972-41626bf81e9f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f4913473-9bcb-4d18-b972-41626bf81e9f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:32.329397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:32.330743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:32.332287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 479/978] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:35:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:32.337157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4913473-9bcb-4d18-b972-41626bf81e9f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:32.406331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa31e85-0e74-4419-a643-9000620db02d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.445304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45b853-0193-4b2c-ae72-2bc3a148542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.445927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45b853-0193-4b2c-ae72-2bc3a148542b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.446206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45b853-0193-4b2c-ae72-2bc3a148542b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.446479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45b853-0193-4b2c-ae72-2bc3a148542b None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.447153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45b853-0193-4b2c-ae72-2bc3a148542b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:32.447460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45b853-0193-4b2c-ae72-2bc3a148542b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.447736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4913473-9bcb-4d18-b972-41626bf81e9f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.448829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45b853-0193-4b2c-ae72-2bc3a148542b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.454105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 500/979] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:32.460583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45b853-0193-4b2c-ae72-2bc3a148542b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:32.489252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88195b-8d88-4d13-8a94-ee62b7505dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.490439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88195b-8d88-4d13-8a94-ee62b7505dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.491346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88195b-8d88-4d13-8a94-ee62b7505dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.492149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88195b-8d88-4d13-8a94-ee62b7505dd8 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.493363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88195b-8d88-4d13-8a94-ee62b7505dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:32.494259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88195b-8d88-4d13-8a94-ee62b7505dd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.496252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88195b-8d88-4d13-8a94-ee62b7505dd8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.511522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:32.525851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 480/980] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Aug 18 20:35:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:32.526942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88195b-8d88-4d13-8a94-ee62b7505dd8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:32.544104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:32.590557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45b853-0193-4b2c-ae72-2bc3a148542b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.629926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5567b6-2252-4842-baa1-c5bfaf63d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.630540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5567b6-2252-4842-baa1-c5bfaf63d703 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.630837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5567b6-2252-4842-baa1-c5bfaf63d703 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.631108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5567b6-2252-4842-baa1-c5bfaf63d703 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.631761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5567b6-2252-4842-baa1-c5bfaf63d703 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:32.632028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5567b6-2252-4842-baa1-c5bfaf63d703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.633638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5567b6-2252-4842-baa1-c5bfaf63d703 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.643464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 501/981] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:32.644470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5567b6-2252-4842-baa1-c5bfaf63d703 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:32.664645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88195b-8d88-4d13-8a94-ee62b7505dd8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.703287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d510ae-902f-4271-b3b3-284448780ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.704011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d510ae-902f-4271-b3b3-284448780ca0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.704290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d510ae-902f-4271-b3b3-284448780ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.704555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d510ae-902f-4271-b3b3-284448780ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.762378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5567b6-2252-4842-baa1-c5bfaf63d703 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.774625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:32.778351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d510ae-902f-4271-b3b3-284448780ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.780096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d510ae-902f-4271-b3b3-284448780ca0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.804933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0753-a166-41ab-973e-d0e45b28d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.805790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0753-a166-41ab-973e-d0e45b28d662 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.806242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0753-a166-41ab-973e-d0e45b28d662 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.806692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0753-a166-41ab-973e-d0e45b28d662 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.807592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0753-a166-41ab-973e-d0e45b28d662 None admin] RBAC: Adding query filter params (interface=admin, service_id=908a266615794f2eb71829cf5fea175b, region_id=RegionOne) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:32.808060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0753-a166-41ab-973e-d0e45b28d662 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.809564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0753-a166-41ab-973e-d0e45b28d662 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.813004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:32.821838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 502/982] 10.222.0.65 () {56 vars in 1249 bytes} [Thu Aug 18 20:35:32 2022] GET /identity/v3/endpoints?service_id=908a266615794f2eb71829cf5fea175b&interface=admin®ion_id=RegionOne => generated 193 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:32.822730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0753-a166-41ab-973e-d0e45b28d662 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:32.900066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 481/983] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:32 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:35:32.901158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d510ae-902f-4271-b3b3-284448780ca0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:32.940266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0753-a166-41ab-973e-d0e45b28d662 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:32.979718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f72261-2f7b-4f7b-a34c-ff367f0ad672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:32.980324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f72261-2f7b-4f7b-a34c-ff367f0ad672 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:32.980604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f72261-2f7b-4f7b-a34c-ff367f0ad672 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:32.980877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f72261-2f7b-4f7b-a34c-ff367f0ad672 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:32.981476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f72261-2f7b-4f7b-a34c-ff367f0ad672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:32.982877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f72261-2f7b-4f7b-a34c-ff367f0ad672 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:32.989993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 503/984] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:32 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:35:33.020168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:33.025103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d510ae-902f-4271-b3b3-284448780ca0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:33.066052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51645f-bf24-463c-9a5c-5baccfe0d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:33.066713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51645f-bf24-463c-9a5c-5baccfe0d2eb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:33.067011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51645f-bf24-463c-9a5c-5baccfe0d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:33.067276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51645f-bf24-463c-9a5c-5baccfe0d2eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:33.079154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51645f-bf24-463c-9a5c-5baccfe0d2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:33.080635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51645f-bf24-463c-9a5c-5baccfe0d2eb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-4e51645f-bf24-463c-9a5c-5baccfe0d2eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:33.098541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:33.099672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:33.100654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:33.100654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:33.100654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:33.100654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 482/985] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:33.105550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f72261-2f7b-4f7b-a34c-ff367f0ad672 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:33.176919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:33.219878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f72261-2f7b-4f7b-a34c-ff367f0ad672 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:33.259084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7fa35-d276-48fc-8b83-1544e2502cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:33.259695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7fa35-d276-48fc-8b83-1544e2502cb1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:33.259974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7fa35-d276-48fc-8b83-1544e2502cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:33.260247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7fa35-d276-48fc-8b83-1544e2502cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:33.260917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7fa35-d276-48fc-8b83-1544e2502cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:33.261197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7fa35-d276-48fc-8b83-1544e2502cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:33.262558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7fa35-d276-48fc-8b83-1544e2502cb1 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:33.275269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 504/986] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:33.280588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51645f-bf24-463c-9a5c-5baccfe0d2eb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:33.385853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51645f-bf24-463c-9a5c-5baccfe0d2eb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:33.420281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aece1-0c5c-41b4-9db1-51c645d7cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:33.420918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aece1-0c5c-41b4-9db1-51c645d7cd62 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:33.421201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aece1-0c5c-41b4-9db1-51c645d7cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:33.421476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aece1-0c5c-41b4-9db1-51c645d7cd62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:33.429396 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962aece1-0c5c-41b4-9db1-51c645d7cd62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:33.430809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962aece1-0c5c-41b4-9db1-51c645d7cd62 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-962aece1-0c5c-41b4-9db1-51c645d7cd62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:33.442670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:33.443616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:33.444539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:33.444539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:33.444539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:33.444539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:33.444539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:33.444539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:33.444539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:33.444539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:33.444539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 483/987] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:33.451257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7fa35-d276-48fc-8b83-1544e2502cb1 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:33.564173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7fa35-d276-48fc-8b83-1544e2502cb1 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:33.595096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:33.608793 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ced854-95d5-48e0-baf8-f172b6a734d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:33.609745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced854-95d5-48e0-baf8-f172b6a734d4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:33.610191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced854-95d5-48e0-baf8-f172b6a734d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:33.610635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced854-95d5-48e0-baf8-f172b6a734d4 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:33.611792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ced854-95d5-48e0-baf8-f172b6a734d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:33.612353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ced854-95d5-48e0-baf8-f172b6a734d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:33.614361 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ced854-95d5-48e0-baf8-f172b6a734d4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:33.632705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 505/988] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:33.634228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aece1-0c5c-41b4-9db1-51c645d7cd62 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:33.648581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:33.738850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aece1-0c5c-41b4-9db1-51c645d7cd62 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:33.775375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d36ac9-4f6c-45c5-aa8a-3b2d68ad7cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:33.775990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d36ac9-4f6c-45c5-aa8a-3b2d68ad7cf2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:33.776267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d36ac9-4f6c-45c5-aa8a-3b2d68ad7cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:33.776527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d36ac9-4f6c-45c5-aa8a-3b2d68ad7cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:33.777275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d36ac9-4f6c-45c5-aa8a-3b2d68ad7cf2 None admin] RBAC: Adding query filter params (role.id=c798b7c9ae25488d8324caed1ed4a055, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=18429472ab6b403ea10105bf9239ce21) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:33.777563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d36ac9-4f6c-45c5-aa8a-3b2d68ad7cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:33.779093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d36ac9-4f6c-45c5-aa8a-3b2d68ad7cf2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:33.790806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 484/989] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:33 2022] GET /identity/v3/role_assignments?user.id=18429472ab6b403ea10105bf9239ce21&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=c798b7c9ae25488d8324caed1ed4a055 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:34.083968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7800687-6fff-471b-9972-d60ce1fe6e03 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:34.084164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7800687-6fff-471b-9972-d60ce1fe6e03 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:34.084430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7800687-6fff-471b-9972-d60ce1fe6e03 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:34.085816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 506/990] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:34.091372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765a46c-069b-4011-8ae5-24dd1603e0a6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:34.091659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765a46c-069b-4011-8ae5-24dd1603e0a6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:34.091929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765a46c-069b-4011-8ae5-24dd1603e0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:34.110110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6765a46c-069b-4011-8ae5-24dd1603e0a6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:34.111339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6765a46c-069b-4011-8ae5-24dd1603e0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:34.183440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 485/991] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:34.460510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7800687-6fff-471b-9972-d60ce1fe6e03 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:34.577444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7800687-6fff-471b-9972-d60ce1fe6e03 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:34.618810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94807634-7af1-4758-ab94-19b75fbfd716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:34.619446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94807634-7af1-4758-ab94-19b75fbfd716 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:34.619725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94807634-7af1-4758-ab94-19b75fbfd716 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:34.619998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94807634-7af1-4758-ab94-19b75fbfd716 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:34.620581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94807634-7af1-4758-ab94-19b75fbfd716 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:34.621950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94807634-7af1-4758-ab94-19b75fbfd716 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-94807634-7af1-4758-ab94-19b75fbfd716 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:34.631771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:34.632827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:34.635969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 507/992] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:34.639732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765a46c-069b-4011-8ae5-24dd1603e0a6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:34.645052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:34.753728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765a46c-069b-4011-8ae5-24dd1603e0a6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:34.788462 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a571f3-4f52-4df0-b819-5acb81f79c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:34.789186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a571f3-4f52-4df0-b819-5acb81f79c67 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:34.789347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a571f3-4f52-4df0-b819-5acb81f79c67 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:34.789607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a571f3-4f52-4df0-b819-5acb81f79c67 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:34.790233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a571f3-4f52-4df0-b819-5acb81f79c67 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:34.790531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a571f3-4f52-4df0-b819-5acb81f79c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:34.791963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a571f3-4f52-4df0-b819-5acb81f79c67 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:34.797379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 486/993] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:34.803373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94807634-7af1-4758-ab94-19b75fbfd716 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:34.855319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:34.912739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94807634-7af1-4758-ab94-19b75fbfd716 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:34.949265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14685769-5012-4e16-92a8-6f4570aede03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:34.949871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14685769-5012-4e16-92a8-6f4570aede03 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:34.950145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14685769-5012-4e16-92a8-6f4570aede03 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:34.950412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14685769-5012-4e16-92a8-6f4570aede03 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:34.951059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14685769-5012-4e16-92a8-6f4570aede03 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:34.951361 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14685769-5012-4e16-92a8-6f4570aede03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:34.952730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14685769-5012-4e16-92a8-6f4570aede03 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:34.958627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 508/994] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:34.964257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a571f3-4f52-4df0-b819-5acb81f79c67 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:35.032697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52581cbb-ccd9-4da7-b593-f789ff0835e9 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:35.033030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52581cbb-ccd9-4da7-b593-f789ff0835e9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:35.033306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52581cbb-ccd9-4da7-b593-f789ff0835e9 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:35.035504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 509/995] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:35.042701 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea43c9c-e4fa-49fd-a855-e92f5188f9fe None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:35.042969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:35.043102 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea43c9c-e4fa-49fd-a855-e92f5188f9fe None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:35.043493 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea43c9c-e4fa-49fd-a855-e92f5188f9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:35.066892 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-2ea43c9c-e4fa-49fd-a855-e92f5188f9fe None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:35.068652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2ea43c9c-e4fa-49fd-a855-e92f5188f9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:35.083747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a571f3-4f52-4df0-b819-5acb81f79c67 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:35.120944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c45d46-d2f3-4459-9909-0e80a48c9e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:35.121568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c45d46-d2f3-4459-9909-0e80a48c9e4a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:35.121822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c45d46-d2f3-4459-9909-0e80a48c9e4a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:35.122090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c45d46-d2f3-4459-9909-0e80a48c9e4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:35.122802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c45d46-d2f3-4459-9909-0e80a48c9e4a None admin] RBAC: Adding query filter params (interface=public, service_id=257c0ef0a336470798345009a3e439a1, region_id=RegionOne) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:35.123115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c45d46-d2f3-4459-9909-0e80a48c9e4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:35.124485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c45d46-d2f3-4459-9909-0e80a48c9e4a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:35.129803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 487/996] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Aug 18 20:35:34 2022] GET /identity/v3/endpoints?service_id=257c0ef0a336470798345009a3e439a1&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:35.135577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c45d46-d2f3-4459-9909-0e80a48c9e4a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:35.156069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 510/997] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:35.239635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c45d46-d2f3-4459-9909-0e80a48c9e4a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:35.270727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:35.276680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636deba-1ed2-4377-9eb6-f474b8849577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:35.277287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636deba-1ed2-4377-9eb6-f474b8849577 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:35.277650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636deba-1ed2-4377-9eb6-f474b8849577 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:35.277928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636deba-1ed2-4377-9eb6-f474b8849577 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:35.278530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636deba-1ed2-4377-9eb6-f474b8849577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:35.279960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636deba-1ed2-4377-9eb6-f474b8849577 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:35.295138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 488/998] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:35 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:35:35.436800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea43c9c-e4fa-49fd-a855-e92f5188f9fe None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:35.483534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:35.547114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea43c9c-e4fa-49fd-a855-e92f5188f9fe None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:35.594679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceeda2-5b21-49ac-a3d8-d4fb535132d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:35.595314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceeda2-5b21-49ac-a3d8-d4fb535132d5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:35.595552 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceeda2-5b21-49ac-a3d8-d4fb535132d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:35.595827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceeda2-5b21-49ac-a3d8-d4fb535132d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:35.596476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceeda2-5b21-49ac-a3d8-d4fb535132d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:35.598508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceeda2-5b21-49ac-a3d8-d4fb535132d5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-27ceeda2-5b21-49ac-a3d8-d4fb535132d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:35.607882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:35.608908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:35.610413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:35.611452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 511/999] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:35.616434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636deba-1ed2-4377-9eb6-f474b8849577 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:35.722202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636deba-1ed2-4377-9eb6-f474b8849577 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:35.760107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba24e8-b47d-43b8-bb8a-b16bd30306d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:35.760777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba24e8-b47d-43b8-bb8a-b16bd30306d2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:35.761052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba24e8-b47d-43b8-bb8a-b16bd30306d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:35.761318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba24e8-b47d-43b8-bb8a-b16bd30306d2 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:35.762009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba24e8-b47d-43b8-bb8a-b16bd30306d2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:35.762307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba24e8-b47d-43b8-bb8a-b16bd30306d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:35.763696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba24e8-b47d-43b8-bb8a-b16bd30306d2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:35.767525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ff3c-05d3-44ac-9142-49f69073d497 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:35.767814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ff3c-05d3-44ac-9142-49f69073d497 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:35.768126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ff3c-05d3-44ac-9142-49f69073d497 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:35.773540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 489/1000] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:35.773683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 512/1001] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:35.774695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ff3c-05d3-44ac-9142-49f69073d497 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:35.775046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2782b-d1fa-4861-b9cd-923ce37f1d85 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:35.775327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2782b-d1fa-4861-b9cd-923ce37f1d85 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:35.775715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2782b-d1fa-4861-b9cd-923ce37f1d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:35.794753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b1a2782b-d1fa-4861-b9cd-923ce37f1d85 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:35.795984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b1a2782b-d1fa-4861-b9cd-923ce37f1d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:35.859811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:35.872551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 490/1002] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:35.896788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ff3c-05d3-44ac-9142-49f69073d497 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:35.904455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:35.934778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a037-9d54-4276-84ae-c62007b74081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:35.935444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a037-9d54-4276-84ae-c62007b74081 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:35.935719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a037-9d54-4276-84ae-c62007b74081 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:35.935984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a037-9d54-4276-84ae-c62007b74081 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:35.936614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a037-9d54-4276-84ae-c62007b74081 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:35.936965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a037-9d54-4276-84ae-c62007b74081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:35.938389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a037-9d54-4276-84ae-c62007b74081 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:35.949091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 513/1003] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:35.950025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2782b-d1fa-4861-b9cd-923ce37f1d85 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:36.053989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2782b-d1fa-4861-b9cd-923ce37f1d85 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:36.088928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6bc32-0459-41d1-9ac7-6e50a3239696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:36.089535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6bc32-0459-41d1-9ac7-6e50a3239696 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:36.089810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6bc32-0459-41d1-9ac7-6e50a3239696 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:36.090077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6bc32-0459-41d1-9ac7-6e50a3239696 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:36.090730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6bc32-0459-41d1-9ac7-6e50a3239696 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:36.092120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6bc32-0459-41d1-9ac7-6e50a3239696 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:36.114893 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 491/1004] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:35:36.146041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a037-9d54-4276-84ae-c62007b74081 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:36.258812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a037-9d54-4276-84ae-c62007b74081 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:36.303735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89263b-824c-4deb-8d0e-88457f0fa3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:36.304384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89263b-824c-4deb-8d0e-88457f0fa3f8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:36.304662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89263b-824c-4deb-8d0e-88457f0fa3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:36.304929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89263b-824c-4deb-8d0e-88457f0fa3f8 None admin] PATH_INFO: `/v3/services/image` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:36.305545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89263b-824c-4deb-8d0e-88457f0fa3f8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:36.307226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89263b-824c-4deb-8d0e-88457f0fa3f8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-8e89263b-824c-4deb-8d0e-88457f0fa3f8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:36.318633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:36.319886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:36.320745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 514/1005] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Aug 18 20:35:36 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:36.327738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6bc32-0459-41d1-9ac7-6e50a3239696 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:36.384455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:36.439764 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6bc32-0459-41d1-9ac7-6e50a3239696 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:36.475112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b2efa-2af5-4ed0-b360-0de984fc1517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:36.475727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b2efa-2af5-4ed0-b360-0de984fc1517 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:36.476018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b2efa-2af5-4ed0-b360-0de984fc1517 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:36.476271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b2efa-2af5-4ed0-b360-0de984fc1517 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:36.476909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b2efa-2af5-4ed0-b360-0de984fc1517 None admin] RBAC: Adding query filter params (name=image) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:36.477214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b2efa-2af5-4ed0-b360-0de984fc1517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:36.478630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b2efa-2af5-4ed0-b360-0de984fc1517 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:36.489120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 492/1006] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:36.490367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89263b-824c-4deb-8d0e-88457f0fa3f8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:36.523481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:36.602105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89263b-824c-4deb-8d0e-88457f0fa3f8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:36.638878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2f439-cff4-4c66-b18c-27b57b5181dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:36.639406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2f439-cff4-4c66-b18c-27b57b5181dd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:36.639684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2f439-cff4-4c66-b18c-27b57b5181dd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:36.639952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2f439-cff4-4c66-b18c-27b57b5181dd None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:36.640582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2f439-cff4-4c66-b18c-27b57b5181dd None admin] RBAC: Adding query filter params (type=image) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:36.640886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2f439-cff4-4c66-b18c-27b57b5181dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:36.642360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2f439-cff4-4c66-b18c-27b57b5181dd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:36.655039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 515/1007] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:37.251151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a67ff-8a1c-445d-aa39-5a331537f44b None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:37.251700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a67ff-8a1c-445d-aa39-5a331537f44b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:37.251700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a67ff-8a1c-445d-aa39-5a331537f44b None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:37.253880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 493/1008] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:37.259455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f524dc-6a6d-420b-8bbd-6b6907e646fc None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:37.259751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f524dc-6a6d-420b-8bbd-6b6907e646fc None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:37.260026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f524dc-6a6d-420b-8bbd-6b6907e646fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:37.278997 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d5f524dc-6a6d-420b-8bbd-6b6907e646fc None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:37.280126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d5f524dc-6a6d-420b-8bbd-6b6907e646fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:37.349335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 516/1009] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:37.623137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a67ff-8a1c-445d-aa39-5a331537f44b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:37.738111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a67ff-8a1c-445d-aa39-5a331537f44b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:37.753617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:37.778451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8803e-cead-414e-9b5d-e7cf549a8695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:37.779117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8803e-cead-414e-9b5d-e7cf549a8695 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:37.779400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8803e-cead-414e-9b5d-e7cf549a8695 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:37.779675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8803e-cead-414e-9b5d-e7cf549a8695 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:37.780334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8803e-cead-414e-9b5d-e7cf549a8695 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:37.783747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8803e-cead-414e-9b5d-e7cf549a8695 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-64a8803e-cead-414e-9b5d-e7cf549a8695 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:37.793724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:37.795106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:37.796683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:37.799223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 494/1010] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:37.801207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f524dc-6a6d-420b-8bbd-6b6907e646fc None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:37.827345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:37.910421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f524dc-6a6d-420b-8bbd-6b6907e646fc None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:37.946571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00e426-ea6a-4ed7-be4a-32f524d71a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:37.947218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00e426-ea6a-4ed7-be4a-32f524d71a77 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:37.947496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00e426-ea6a-4ed7-be4a-32f524d71a77 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:37.947768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00e426-ea6a-4ed7-be4a-32f524d71a77 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:37.948404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00e426-ea6a-4ed7-be4a-32f524d71a77 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:37.948704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00e426-ea6a-4ed7-be4a-32f524d71a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:37.950068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00e426-ea6a-4ed7-be4a-32f524d71a77 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:37.959008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 517/1011] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:37.962939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8803e-cead-414e-9b5d-e7cf549a8695 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:38.073115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8803e-cead-414e-9b5d-e7cf549a8695 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:38.086060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569e23-3be1-4b82-8b9d-31ffacb5e228 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:38.086413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569e23-3be1-4b82-8b9d-31ffacb5e228 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:38.086612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569e23-3be1-4b82-8b9d-31ffacb5e228 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:38.088289 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 518/1012] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:38.093071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caba89-86ca-47d7-abca-b1363cf9cedb None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:38.093356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caba89-86ca-47d7-abca-b1363cf9cedb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:38.093630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caba89-86ca-47d7-abca-b1363cf9cedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:38.111174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2123f-ed52-4d8d-8dc6-6f7e8a8038a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:38.112148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2123f-ed52-4d8d-8dc6-6f7e8a8038a5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:38.112650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2123f-ed52-4d8d-8dc6-6f7e8a8038a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:38.112964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-24caba89-86ca-47d7-abca-b1363cf9cedb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:38.113076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2123f-ed52-4d8d-8dc6-6f7e8a8038a5 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:38.113689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2123f-ed52-4d8d-8dc6-6f7e8a8038a5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:38.113999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2123f-ed52-4d8d-8dc6-6f7e8a8038a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:38.114092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-24caba89-86ca-47d7-abca-b1363cf9cedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:38.115407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2123f-ed52-4d8d-8dc6-6f7e8a8038a5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:38.120998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 495/1013] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:38.126715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2123f-ed52-4d8d-8dc6-6f7e8a8038a5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:38.182929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:38.194891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 519/1014] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:38.242869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2123f-ed52-4d8d-8dc6-6f7e8a8038a5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:38.278272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9f061-7769-4cd6-b41e-396ac726b8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:38.279661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f061-7769-4cd6-b41e-396ac726b8d1 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:38.280122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f061-7769-4cd6-b41e-396ac726b8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:38.280587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f061-7769-4cd6-b41e-396ac726b8d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:38.281412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f061-7769-4cd6-b41e-396ac726b8d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:38.283024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f061-7769-4cd6-b41e-396ac726b8d1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:38.304100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 496/1015] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:38.472131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caba89-86ca-47d7-abca-b1363cf9cedb None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:38.491776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:38.553774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a420bb-bdb9-4014-ad91-ee32e0c535b1 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:38.554098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a420bb-bdb9-4014-ad91-ee32e0c535b1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:38.554336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a420bb-bdb9-4014-ad91-ee32e0c535b1 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:38.558062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 497/1016] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:38.566329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1ad2d-22f6-4b35-b62b-02fb4619915d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:38.566621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1ad2d-22f6-4b35-b62b-02fb4619915d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:38.568746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1ad2d-22f6-4b35-b62b-02fb4619915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:38.586488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caba89-86ca-47d7-abca-b1363cf9cedb None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:38.588510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-72e1ad2d-22f6-4b35-b62b-02fb4619915d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:38.589767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-72e1ad2d-22f6-4b35-b62b-02fb4619915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:38.632272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76a77e-824e-44cc-803b-399e37ae378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:38.632915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76a77e-824e-44cc-803b-399e37ae378a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:38.633453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76a77e-824e-44cc-803b-399e37ae378a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:38.633725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76a77e-824e-44cc-803b-399e37ae378a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:38.634850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76a77e-824e-44cc-803b-399e37ae378a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:38.636528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76a77e-824e-44cc-803b-399e37ae378a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:38.638126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 520/1017] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:38.644092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76a77e-824e-44cc-803b-399e37ae378a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:38.663773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 498/1018] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:38 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:38.729513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:38.750602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76a77e-824e-44cc-803b-399e37ae378a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:38.788012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31aa7bc-bca0-48e4-8aaf-8ada9fd4e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:38.788626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa7bc-bca0-48e4-8aaf-8ada9fd4e230 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:38.788902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa7bc-bca0-48e4-8aaf-8ada9fd4e230 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:38.789178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa7bc-bca0-48e4-8aaf-8ada9fd4e230 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:38.789845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31aa7bc-bca0-48e4-8aaf-8ada9fd4e230 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:38.791311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31aa7bc-bca0-48e4-8aaf-8ada9fd4e230 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:38.830856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 521/1019] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:38 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:35:38.935503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1ad2d-22f6-4b35-b62b-02fb4619915d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:38.967237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:39.052638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1ad2d-22f6-4b35-b62b-02fb4619915d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:39.089938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f619d-9cde-451d-a2ad-995575ccad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:39.090553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f619d-9cde-451d-a2ad-995575ccad07 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:39.090958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f619d-9cde-451d-a2ad-995575ccad07 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:39.091134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f619d-9cde-451d-a2ad-995575ccad07 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:39.091777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f619d-9cde-451d-a2ad-995575ccad07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:39.093183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f619d-9cde-451d-a2ad-995575ccad07 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:39.110188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 499/1020] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:38 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:40.322983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6eed5-1ae5-49de-b350-57bdfd5add67 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:40.323511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6eed5-1ae5-49de-b350-57bdfd5add67 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:40.323511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6eed5-1ae5-49de-b350-57bdfd5add67 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:40.325000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 522/1021] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:40.329905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfa674-98f8-49c6-95eb-7fb2c63ce482 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:40.330285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfa674-98f8-49c6-95eb-7fb2c63ce482 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:40.330591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfa674-98f8-49c6-95eb-7fb2c63ce482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:40.348455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a4cfa674-98f8-49c6-95eb-7fb2c63ce482 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:40.349638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a4cfa674-98f8-49c6-95eb-7fb2c63ce482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:40.426604 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 500/1022] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:40.694263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6eed5-1ae5-49de-b350-57bdfd5add67 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:40.804868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49923ab5-9aa4-4848-9d5c-36c48f4fcac6 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:40.805191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49923ab5-9aa4-4848-9d5c-36c48f4fcac6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:40.805418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49923ab5-9aa4-4848-9d5c-36c48f4fcac6 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:40.805785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6eed5-1ae5-49de-b350-57bdfd5add67 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:40.806746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 501/1023] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:40.811666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f75a4-860f-4f53-9017-1e4aea004ffc None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:40.811943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f75a4-860f-4f53-9017-1e4aea004ffc None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:40.812214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f75a4-860f-4f53-9017-1e4aea004ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:40.831218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-371f75a4-860f-4f53-9017-1e4aea004ffc None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:40.832404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-371f75a4-860f-4f53-9017-1e4aea004ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:40.842603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:40.850519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb514e8-49d0-4961-980d-9277d2d4ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:40.851334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb514e8-49d0-4961-980d-9277d2d4ade9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:40.851465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb514e8-49d0-4961-980d-9277d2d4ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:40.851687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb514e8-49d0-4961-980d-9277d2d4ade9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:40.853913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:40.867802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb514e8-49d0-4961-980d-9277d2d4ade9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-edb514e8-49d0-4961-980d-9277d2d4ade9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:40.872252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:40.873234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:40.874109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 523/1024] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Aug 18 20:35:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:40.879359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb514e8-49d0-4961-980d-9277d2d4ade9 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:40.911386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 502/1025] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:40.985694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb514e8-49d0-4961-980d-9277d2d4ade9 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.020232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ece95-930a-4918-a32d-2bd5a05434b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.020839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ece95-930a-4918-a32d-2bd5a05434b7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.021114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ece95-930a-4918-a32d-2bd5a05434b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.021381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ece95-930a-4918-a32d-2bd5a05434b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.022033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ece95-930a-4918-a32d-2bd5a05434b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:41.022332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ece95-930a-4918-a32d-2bd5a05434b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:41.023705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ece95-930a-4918-a32d-2bd5a05434b7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:41.032157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 524/1026] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:41.037679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f75a4-860f-4f53-9017-1e4aea004ffc None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.069749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3903fe-2257-4114-96b9-0891196431be None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.070112 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3903fe-2257-4114-96b9-0891196431be None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.070292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3903fe-2257-4114-96b9-0891196431be None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.071694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 525/1027] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:41.076753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea6dcc-ceed-4e5f-9eff-adf3c427e42c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.077275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea6dcc-ceed-4e5f-9eff-adf3c427e42c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.077556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea6dcc-ceed-4e5f-9eff-adf3c427e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.095629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-35ea6dcc-ceed-4e5f-9eff-adf3c427e42c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:41.096986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-35ea6dcc-ceed-4e5f-9eff-adf3c427e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:41.150049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f75a4-860f-4f53-9017-1e4aea004ffc None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.153583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:41.171879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 526/1028] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:41.181564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea6dcc-ceed-4e5f-9eff-adf3c427e42c None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.186963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86708b80-0f26-449b-bcc0-2a8a366b9de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.187638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86708b80-0f26-449b-bcc0-2a8a366b9de8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.187894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86708b80-0f26-449b-bcc0-2a8a366b9de8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.188169 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86708b80-0f26-449b-bcc0-2a8a366b9de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.202787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86708b80-0f26-449b-bcc0-2a8a366b9de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:41.204712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86708b80-0f26-449b-bcc0-2a8a366b9de8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:41.208196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-86708b80-0f26-449b-bcc0-2a8a366b9de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:41.223849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:41.225128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:41.227084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:41.227084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:41.227084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:41.227084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 503/1029] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:41.230810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86708b80-0f26-449b-bcc0-2a8a366b9de8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.300309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea6dcc-ceed-4e5f-9eff-adf3c427e42c None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.339874 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c4c71-c50e-4152-a08e-a00f053deb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.340642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c4c71-c50e-4152-a08e-a00f053deb2e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.340922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c4c71-c50e-4152-a08e-a00f053deb2e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.341243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c4c71-c50e-4152-a08e-a00f053deb2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.342468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c4c71-c50e-4152-a08e-a00f053deb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:41.343949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c4c71-c50e-4152-a08e-a00f053deb2e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:41.346101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 527/1030] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:41.351424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c4c71-c50e-4152-a08e-a00f053deb2e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.355534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86708b80-0f26-449b-bcc0-2a8a366b9de8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.394526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf3a2-23b9-4cdc-89a0-eeef747d5609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.395199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf3a2-23b9-4cdc-89a0-eeef747d5609 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.395484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf3a2-23b9-4cdc-89a0-eeef747d5609 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.395760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf3a2-23b9-4cdc-89a0-eeef747d5609 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.396407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaf3a2-23b9-4cdc-89a0-eeef747d5609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:41.396711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaf3a2-23b9-4cdc-89a0-eeef747d5609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:41.398095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaf3a2-23b9-4cdc-89a0-eeef747d5609 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:41.412998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 504/1031] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:41.415000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:41.419314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf3a2-23b9-4cdc-89a0-eeef747d5609 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.469761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c4c71-c50e-4152-a08e-a00f053deb2e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.482650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:41.507108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8d33-113a-42a4-8373-e03f5e5c3a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.507727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8d33-113a-42a4-8373-e03f5e5c3a76 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.508256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8d33-113a-42a4-8373-e03f5e5c3a76 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.508534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8d33-113a-42a4-8373-e03f5e5c3a76 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.509179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b8d33-113a-42a4-8373-e03f5e5c3a76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:41.510633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b8d33-113a-42a4-8373-e03f5e5c3a76 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:41.528923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf3a2-23b9-4cdc-89a0-eeef747d5609 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.533308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 528/1032] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:35:41 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:35:41.535209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8d33-113a-42a4-8373-e03f5e5c3a76 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.576449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5023-5daa-420b-9c3a-ff5dd7047dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.577100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5023-5daa-420b-9c3a-ff5dd7047dc2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.577376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5023-5daa-420b-9c3a-ff5dd7047dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.577646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5023-5daa-420b-9c3a-ff5dd7047dc2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.587999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b5023-5daa-420b-9c3a-ff5dd7047dc2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:41.590840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b5023-5daa-420b-9c3a-ff5dd7047dc2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-642b5023-5daa-420b-9c3a-ff5dd7047dc2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:41.606101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:41.607392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:41.608613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:41.612941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 505/1033] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Aug 18 20:35:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:41.614174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5023-5daa-420b-9c3a-ff5dd7047dc2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.663492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8d33-113a-42a4-8373-e03f5e5c3a76 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.675562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:41.708490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184d79-a65d-41f8-a5fe-d55d2df5f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.709285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184d79-a65d-41f8-a5fe-d55d2df5f87c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.709564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184d79-a65d-41f8-a5fe-d55d2df5f87c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.709841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184d79-a65d-41f8-a5fe-d55d2df5f87c None admin] PATH_INFO: `/v3/services/image` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.710426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21184d79-a65d-41f8-a5fe-d55d2df5f87c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:41.711841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21184d79-a65d-41f8-a5fe-d55d2df5f87c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-21184d79-a65d-41f8-a5fe-d55d2df5f87c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:41.721048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:41.722210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:41.723149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 529/1034] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Aug 18 20:35:41 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:41.728299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184d79-a65d-41f8-a5fe-d55d2df5f87c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.735285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5023-5daa-420b-9c3a-ff5dd7047dc2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.756335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:41.778742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97e936-b976-41ba-b083-6e2bd36dd9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.779533 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97e936-b976-41ba-b083-6e2bd36dd9f2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.779934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97e936-b976-41ba-b083-6e2bd36dd9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.780670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97e936-b976-41ba-b083-6e2bd36dd9f2 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.781517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97e936-b976-41ba-b083-6e2bd36dd9f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:41.781928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97e936-b976-41ba-b083-6e2bd36dd9f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:41.784032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97e936-b976-41ba-b083-6e2bd36dd9f2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:41.813803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 506/1035] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Aug 18 20:35:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:41.820323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97e936-b976-41ba-b083-6e2bd36dd9f2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.850752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184d79-a65d-41f8-a5fe-d55d2df5f87c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.890039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb26cf-18b6-46cd-9e66-68f20b8681da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.890664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb26cf-18b6-46cd-9e66-68f20b8681da None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.890973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb26cf-18b6-46cd-9e66-68f20b8681da None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.891246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb26cf-18b6-46cd-9e66-68f20b8681da None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:41.891891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb26cf-18b6-46cd-9e66-68f20b8681da None admin] RBAC: Adding query filter params (name=image) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:41.892200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb26cf-18b6-46cd-9e66-68f20b8681da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:41.894016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb26cf-18b6-46cd-9e66-68f20b8681da None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:41.904748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 530/1036] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:41.905789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb26cf-18b6-46cd-9e66-68f20b8681da None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:41.930752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97e936-b976-41ba-b083-6e2bd36dd9f2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:41.955789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:41.968659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11983e13-e461-45f8-b995-cbfc3a3db7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:41.969271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11983e13-e461-45f8-b995-cbfc3a3db7d1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:41.969674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11983e13-e461-45f8-b995-cbfc3a3db7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:41.969950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11983e13-e461-45f8-b995-cbfc3a3db7d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.017279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:42.018611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb26cf-18b6-46cd-9e66-68f20b8681da None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:42.047125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11983e13-e461-45f8-b995-cbfc3a3db7d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:42.048826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11983e13-e461-45f8-b995-cbfc3a3db7d1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:42.056056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfd0bf-94e2-4cb0-8893-a4feb3a5f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:42.056676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd0bf-94e2-4cb0-8893-a4feb3a5f9cf None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:42.056953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd0bf-94e2-4cb0-8893-a4feb3a5f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:42.057220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd0bf-94e2-4cb0-8893-a4feb3a5f9cf None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.057850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfd0bf-94e2-4cb0-8893-a4feb3a5f9cf None admin] RBAC: Adding query filter params (type=image) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:42.058155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfd0bf-94e2-4cb0-8893-a4feb3a5f9cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:42.059541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfd0bf-94e2-4cb0-8893-a4feb3a5f9cf None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:42.070073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 531/1037] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:42.071178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfd0bf-94e2-4cb0-8893-a4feb3a5f9cf None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:42.164878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 507/1038] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:35:42.170544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11983e13-e461-45f8-b995-cbfc3a3db7d1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:42.187741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfd0bf-94e2-4cb0-8893-a4feb3a5f9cf None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:42.189413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:42.228341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf2fe0-12a5-476b-a357-e1fdb2b76dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:42.228905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf2fe0-12a5-476b-a357-e1fdb2b76dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:42.229294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf2fe0-12a5-476b-a357-e1fdb2b76dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:42.229626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf2fe0-12a5-476b-a357-e1fdb2b76dd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.230389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf2fe0-12a5-476b-a357-e1fdb2b76dd8 None admin] RBAC: Adding query filter params (interface=public, service_id=3a04d70750ac4ad6a4e86b820617b6ff, region_id=RegionOne) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:42.230760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf2fe0-12a5-476b-a357-e1fdb2b76dd8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:42.232195 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf2fe0-12a5-476b-a357-e1fdb2b76dd8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:42.238465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 532/1039] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Aug 18 20:35:42 2022] GET /identity/v3/endpoints?service_id=3a04d70750ac4ad6a4e86b820617b6ff&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:42.243965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf2fe0-12a5-476b-a357-e1fdb2b76dd8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:42.264047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:42.291916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11983e13-e461-45f8-b995-cbfc3a3db7d1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:42.335849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778fab6-6ec3-425b-a56a-a50d7b46b1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:42.336666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778fab6-6ec3-425b-a56a-a50d7b46b1ea None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:42.337120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778fab6-6ec3-425b-a56a-a50d7b46b1ea None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:42.337455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778fab6-6ec3-425b-a56a-a50d7b46b1ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.349033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778fab6-6ec3-425b-a56a-a50d7b46b1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:42.350475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778fab6-6ec3-425b-a56a-a50d7b46b1ea None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:42.351867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf2fe0-12a5-476b-a357-e1fdb2b76dd8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-3778fab6-6ec3-425b-a56a-a50d7b46b1ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:42.366096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:42.367494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:42.368402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:42.368402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:42.368402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:42.372217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 508/1040] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:42.372892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778fab6-6ec3-425b-a56a-a50d7b46b1ea None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:42.391130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7eb20-2455-42c1-be7c-47262d714f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:42.391700 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7eb20-2455-42c1-be7c-47262d714f1a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:42.391977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7eb20-2455-42c1-be7c-47262d714f1a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:42.392409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7eb20-2455-42c1-be7c-47262d714f1a None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.393495 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7eb20-2455-42c1-be7c-47262d714f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:42.395057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7eb20-2455-42c1-be7c-47262d714f1a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:42.403879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 533/1041] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:42 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:35:42.484798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778fab6-6ec3-425b-a56a-a50d7b46b1ea None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:42.514341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:42.526140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24664485-db92-4149-b475-c137d1b76ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:42.527188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24664485-db92-4149-b475-c137d1b76ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:42.527669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24664485-db92-4149-b475-c137d1b76ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:42.528147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24664485-db92-4149-b475-c137d1b76ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.529000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24664485-db92-4149-b475-c137d1b76ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:42.529519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24664485-db92-4149-b475-c137d1b76ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:42.531164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24664485-db92-4149-b475-c137d1b76ae5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:42.545843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 509/1042] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:42.552028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7eb20-2455-42c1-be7c-47262d714f1a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:42.593496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:42.666929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7eb20-2455-42c1-be7c-47262d714f1a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:42.701191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2743a0-d589-406e-af85-67c5374cb8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:42.701788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2743a0-d589-406e-af85-67c5374cb8a4 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:42.702063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2743a0-d589-406e-af85-67c5374cb8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:42.702328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2743a0-d589-406e-af85-67c5374cb8a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.710231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2743a0-d589-406e-af85-67c5374cb8a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:42.711722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2743a0-d589-406e-af85-67c5374cb8a4 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-3f2743a0-d589-406e-af85-67c5374cb8a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:42.724569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:42.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:42.726564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:42.726564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:42.726564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:42.726564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:42.726564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:42.726564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:42.726564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:42.726564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:42.726564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 534/1043] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:42.731526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24664485-db92-4149-b475-c137d1b76ae5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:42.838992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24664485-db92-4149-b475-c137d1b76ae5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:42.874015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6f3f9-6653-45ad-8402-17652ee43200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:42.874628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6f3f9-6653-45ad-8402-17652ee43200 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:42.874938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6f3f9-6653-45ad-8402-17652ee43200 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:42.875213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6f3f9-6653-45ad-8402-17652ee43200 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.875902 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6f3f9-6653-45ad-8402-17652ee43200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:42.876204 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6f3f9-6653-45ad-8402-17652ee43200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:42.878168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6f3f9-6653-45ad-8402-17652ee43200 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:42.897100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 510/1044] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:42.903334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2743a0-d589-406e-af85-67c5374cb8a4 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:42.998437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:43.010436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2743a0-d589-406e-af85-67c5374cb8a4 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:43.045137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c32a4-8784-4776-86bb-51887300251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:43.045840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c32a4-8784-4776-86bb-51887300251b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:43.046176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c32a4-8784-4776-86bb-51887300251b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:43.046509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c32a4-8784-4776-86bb-51887300251b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:43.047330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c32a4-8784-4776-86bb-51887300251b None admin] RBAC: Adding query filter params (role.id=c798b7c9ae25488d8324caed1ed4a055, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=d6e704b8291b4934a20cdde2ef127493) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:43.047699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c32a4-8784-4776-86bb-51887300251b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:43.049510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c32a4-8784-4776-86bb-51887300251b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:43.062817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 535/1045] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:42 2022] GET /identity/v3/role_assignments?user.id=d6e704b8291b4934a20cdde2ef127493&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=c798b7c9ae25488d8324caed1ed4a055 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:43.585332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d6d25-a3db-440b-8673-c436923e1314 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:43.585859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d6d25-a3db-440b-8673-c436923e1314 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:43.585859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d6d25-a3db-440b-8673-c436923e1314 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:43.587291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 511/1046] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:43.594481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef528b-5086-4104-aac2-b9750d0f0ecf None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:43.594942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef528b-5086-4104-aac2-b9750d0f0ecf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:43.595066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef528b-5086-4104-aac2-b9750d0f0ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:43.614716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-60ef528b-5086-4104-aac2-b9750d0f0ecf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:43.615943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-60ef528b-5086-4104-aac2-b9750d0f0ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:43.686923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 536/1047] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:43.954208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d6d25-a3db-440b-8673-c436923e1314 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:44.005055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:44.063369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d6d25-a3db-440b-8673-c436923e1314 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:44.098474 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae6247-4468-4ffa-b940-6d6347960784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:44.099136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae6247-4468-4ffa-b940-6d6347960784 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:44.099418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae6247-4468-4ffa-b940-6d6347960784 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:44.099692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae6247-4468-4ffa-b940-6d6347960784 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:44.110142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae6247-4468-4ffa-b940-6d6347960784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1dae6247-4468-4ffa-b940-6d6347960784 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:44.115796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:44.116761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:44.123247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 512/1048] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:44.123991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef528b-5086-4104-aac2-b9750d0f0ecf None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:44.211665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:44.229636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef528b-5086-4104-aac2-b9750d0f0ecf None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:44.265128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f88e5-de03-4cb8-b932-d59ad33daec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:44.265745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f88e5-de03-4cb8-b932-d59ad33daec6 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:44.266025 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f88e5-de03-4cb8-b932-d59ad33daec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:44.266296 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f88e5-de03-4cb8-b932-d59ad33daec6 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:44.266978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f88e5-de03-4cb8-b932-d59ad33daec6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:44.267281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f88e5-de03-4cb8-b932-d59ad33daec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:44.269296 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f88e5-de03-4cb8-b932-d59ad33daec6 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:44.281978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 537/1049] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:44.283435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae6247-4468-4ffa-b940-6d6347960784 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:44.375988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325894b-957a-49e8-a6d4-a9a8b8ff14cf None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:44.375988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325894b-957a-49e8-a6d4-a9a8b8ff14cf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:44.376261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325894b-957a-49e8-a6d4-a9a8b8ff14cf None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:44.378194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 538/1050] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:44.383233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222eccf-d6e4-47be-8e23-14d27407fe51 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:44.383524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222eccf-d6e4-47be-8e23-14d27407fe51 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:44.383798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222eccf-d6e4-47be-8e23-14d27407fe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:44.388676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae6247-4468-4ffa-b940-6d6347960784 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:44.400661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:44.403383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b222eccf-d6e4-47be-8e23-14d27407fe51 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:44.404677 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b222eccf-d6e4-47be-8e23-14d27407fe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:44.432631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09bdd-a741-4c26-999f-cad659aedafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:44.433266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09bdd-a741-4c26-999f-cad659aedafc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:44.433549 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09bdd-a741-4c26-999f-cad659aedafc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:44.433818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09bdd-a741-4c26-999f-cad659aedafc None admin] PATH_INFO: `/v3/users/50f92166d4cc4ebdb651fe3cf0e7d5b6` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:44.449201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af09bdd-a741-4c26-999f-cad659aedafc None admin] RBAC: Authorizing `identity:get_user(user_id=50f92166d4cc4ebdb651fe3cf0e7d5b6)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:44.450659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af09bdd-a741-4c26-999f-cad659aedafc None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:44.452497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 513/1051] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:44 2022] GET /identity/v3/users/50f92166d4cc4ebdb651fe3cf0e7d5b6 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:44.458173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09bdd-a741-4c26-999f-cad659aedafc None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:44.478884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 539/1052] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:44.567928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09bdd-a741-4c26-999f-cad659aedafc None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:44.616083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609001c-5a16-43b5-a5ea-53e7057fb03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:44.616792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609001c-5a16-43b5-a5ea-53e7057fb03c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:44.617004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609001c-5a16-43b5-a5ea-53e7057fb03c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:44.617242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609001c-5a16-43b5-a5ea-53e7057fb03c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:44.651987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:44.691889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609001c-5a16-43b5-a5ea-53e7057fb03c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:44.693371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609001c-5a16-43b5-a5ea-53e7057fb03c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:44.762360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222eccf-d6e4-47be-8e23-14d27407fe51 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:44.796388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 514/1053] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:35:44.802758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609001c-5a16-43b5-a5ea-53e7057fb03c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:44.845187 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:44.870119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222eccf-d6e4-47be-8e23-14d27407fe51 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:44.871998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:44.908974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3b66e-e73c-459e-a37f-3977dca42913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:44.909632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3b66e-e73c-459e-a37f-3977dca42913 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:44.909914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3b66e-e73c-459e-a37f-3977dca42913 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:44.910187 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3b66e-e73c-459e-a37f-3977dca42913 None admin] PATH_INFO: `/v3/services/image` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:44.910803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3b66e-e73c-459e-a37f-3977dca42913 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:44.912162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3b66e-e73c-459e-a37f-3977dca42913 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-14b3b66e-e73c-459e-a37f-3977dca42913 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:44.921389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:44.922426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:44.928913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 540/1054] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Aug 18 20:35:44 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:44.929741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609001c-5a16-43b5-a5ea-53e7057fb03c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:44.929819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3b66e-e73c-459e-a37f-3977dca42913 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:44.969366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9e88-b8fb-4c6c-8ca3-5c31cc971b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:44.969999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9e88-b8fb-4c6c-8ca3-5c31cc971b7e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:44.970277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9e88-b8fb-4c6c-8ca3-5c31cc971b7e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:44.970551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9e88-b8fb-4c6c-8ca3-5c31cc971b7e None admin] PATH_INFO: `/v3/projects/04b04b1ca9a84255aad36c7e78aa3713` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:44.972624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9e88-b8fb-4c6c-8ca3-5c31cc971b7e None admin] RBAC: Authorizing `identity:get_project(project_id=04b04b1ca9a84255aad36c7e78aa3713)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:44.974083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9e88-b8fb-4c6c-8ca3-5c31cc971b7e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:44.975760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 515/1055] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:44 2022] GET /identity/v3/projects/04b04b1ca9a84255aad36c7e78aa3713 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:44.981566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9e88-b8fb-4c6c-8ca3-5c31cc971b7e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:45.044719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3b66e-e73c-459e-a37f-3977dca42913 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:45.080101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbc1b7-7a7e-4382-8320-cd2f9ddd3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:45.081255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbc1b7-7a7e-4382-8320-cd2f9ddd3a57 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.081531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbc1b7-7a7e-4382-8320-cd2f9ddd3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.081799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbc1b7-7a7e-4382-8320-cd2f9ddd3a57 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.082425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbc1b7-7a7e-4382-8320-cd2f9ddd3a57 None admin] RBAC: Adding query filter params (name=image) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:45.082727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbc1b7-7a7e-4382-8320-cd2f9ddd3a57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:45.084119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbc1b7-7a7e-4382-8320-cd2f9ddd3a57 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:45.086739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9e88-b8fb-4c6c-8ca3-5c31cc971b7e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:45.088897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 541/1056] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:45.090178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540d8f-b9b1-4c97-9ae0-8c77adfd0db0 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.090465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540d8f-b9b1-4c97-9ae0-8c77adfd0db0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.090737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540d8f-b9b1-4c97-9ae0-8c77adfd0db0 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.091968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 542/1057] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:45.094550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540d8f-b9b1-4c97-9ae0-8c77adfd0db0 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:45.098861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:45.122175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:45.127920 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65085-e527-40f1-92b7-0bba225d6021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:45.128524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65085-e527-40f1-92b7-0bba225d6021 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.128800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65085-e527-40f1-92b7-0bba225d6021 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.129066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65085-e527-40f1-92b7-0bba225d6021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.129790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65085-e527-40f1-92b7-0bba225d6021 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=04b04b1ca9a84255aad36c7e78aa3713, user.id=50f92166d4cc4ebdb651fe3cf0e7d5b6) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:45.130090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65085-e527-40f1-92b7-0bba225d6021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:45.131554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65085-e527-40f1-92b7-0bba225d6021 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:45.145307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 516/1058] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:44 2022] GET /identity/v3/role_assignments?user.id=50f92166d4cc4ebdb651fe3cf0e7d5b6&scope.project.id=04b04b1ca9a84255aad36c7e78aa3713&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:45.145307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e133811-fa4d-4f0b-867d-e8b82682033c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.145307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e133811-fa4d-4f0b-867d-e8b82682033c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.145307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e133811-fa4d-4f0b-867d-e8b82682033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.164698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1e133811-fa4d-4f0b-867d-e8b82682033c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:45.166059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1e133811-fa4d-4f0b-867d-e8b82682033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:45.216967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540d8f-b9b1-4c97-9ae0-8c77adfd0db0 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:45.243016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 517/1059] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:45.262043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462febc-6bef-47cd-9bdd-c3525ea20e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:45.263043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462febc-6bef-47cd-9bdd-c3525ea20e27 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.263580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462febc-6bef-47cd-9bdd-c3525ea20e27 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.264063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462febc-6bef-47cd-9bdd-c3525ea20e27 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.264906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462febc-6bef-47cd-9bdd-c3525ea20e27 None admin] RBAC: Adding query filter params (type=image) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:45.265395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462febc-6bef-47cd-9bdd-c3525ea20e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:45.267028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462febc-6bef-47cd-9bdd-c3525ea20e27 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:45.278297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 543/1060] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:45.279819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e133811-fa4d-4f0b-867d-e8b82682033c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:45.388418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e133811-fa4d-4f0b-867d-e8b82682033c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:45.414084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:45.423382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace104db-82fa-4eb0-a6de-51b6d4d8bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:45.424590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace104db-82fa-4eb0-a6de-51b6d4d8bba6 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.424967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace104db-82fa-4eb0-a6de-51b6d4d8bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.425255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace104db-82fa-4eb0-a6de-51b6d4d8bba6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.425921 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace104db-82fa-4eb0-a6de-51b6d4d8bba6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:45.427339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace104db-82fa-4eb0-a6de-51b6d4d8bba6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:45.447981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 518/1061] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:45.523228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462febc-6bef-47cd-9bdd-c3525ea20e27 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:45.604347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:45.643666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462febc-6bef-47cd-9bdd-c3525ea20e27 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:45.685776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a33c5b-3fcf-4efa-82c5-6622b67b410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:45.686410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33c5b-3fcf-4efa-82c5-6622b67b410e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.686685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33c5b-3fcf-4efa-82c5-6622b67b410e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.686981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33c5b-3fcf-4efa-82c5-6622b67b410e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.698980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a33c5b-3fcf-4efa-82c5-6622b67b410e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-d8a33c5b-3fcf-4efa-82c5-6622b67b410e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:45.703742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:45.704696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:45.706124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:45.707418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 544/1062] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Aug 18 20:35:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:45.711636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace104db-82fa-4eb0-a6de-51b6d4d8bba6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:45.815813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace104db-82fa-4eb0-a6de-51b6d4d8bba6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:45.850063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7f3b3-05ad-4ea2-a114-05fc6aef40bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:45.850672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7f3b3-05ad-4ea2-a114-05fc6aef40bd None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.850976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7f3b3-05ad-4ea2-a114-05fc6aef40bd None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.851244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7f3b3-05ad-4ea2-a114-05fc6aef40bd None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.851892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7f3b3-05ad-4ea2-a114-05fc6aef40bd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:45.852191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7f3b3-05ad-4ea2-a114-05fc6aef40bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:45.853559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7f3b3-05ad-4ea2-a114-05fc6aef40bd None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:45.866313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 519/1063] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:45.867622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a33c5b-3fcf-4efa-82c5-6622b67b410e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:45.975367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a33c5b-3fcf-4efa-82c5-6622b67b410e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:45.998576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:46.011172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34243a-4f0f-479b-a471-a79b716e7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.011807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34243a-4f0f-479b-a471-a79b716e7d91 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.012087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34243a-4f0f-479b-a471-a79b716e7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.012358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34243a-4f0f-479b-a471-a79b716e7d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.023710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34243a-4f0f-479b-a471-a79b716e7d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.025162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34243a-4f0f-479b-a471-a79b716e7d91 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-0b34243a-4f0f-479b-a471-a79b716e7d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:46.039283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:46.040252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:46.041206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:46.041206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:46.041206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:46.041946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 545/1064] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:46.046112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7f3b3-05ad-4ea2-a114-05fc6aef40bd None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.096511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:46.167884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7f3b3-05ad-4ea2-a114-05fc6aef40bd None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.206129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d053b-c638-4a19-b377-f49dee761c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.207011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d053b-c638-4a19-b377-f49dee761c16 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.207460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d053b-c638-4a19-b377-f49dee761c16 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.207875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d053b-c638-4a19-b377-f49dee761c16 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.208762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d053b-c638-4a19-b377-f49dee761c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:46.209208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d053b-c638-4a19-b377-f49dee761c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.210727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d053b-c638-4a19-b377-f49dee761c16 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.227749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 520/1065] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:46.229414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34243a-4f0f-479b-a471-a79b716e7d91 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.333188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34243a-4f0f-479b-a471-a79b716e7d91 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.368915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f13255-f1dd-4ae1-8895-d37756a70412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.369777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f13255-f1dd-4ae1-8895-d37756a70412 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.370203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f13255-f1dd-4ae1-8895-d37756a70412 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.370626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f13255-f1dd-4ae1-8895-d37756a70412 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.379431 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f13255-f1dd-4ae1-8895-d37756a70412 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.381038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f13255-f1dd-4ae1-8895-d37756a70412 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-69f13255-f1dd-4ae1-8895-d37756a70412 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:46.392492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:46.394239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:46.400232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 546/1066] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:46.400859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d053b-c638-4a19-b377-f49dee761c16 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.514314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d053b-c638-4a19-b377-f49dee761c16 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.517442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:46.553057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6795983-2fd9-4283-97e2-c1d220499c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.553634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6795983-2fd9-4283-97e2-c1d220499c68 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.553909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6795983-2fd9-4283-97e2-c1d220499c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.554175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6795983-2fd9-4283-97e2-c1d220499c68 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.554930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6795983-2fd9-4283-97e2-c1d220499c68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:46.555249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6795983-2fd9-4283-97e2-c1d220499c68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.558430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6795983-2fd9-4283-97e2-c1d220499c68 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.582663 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 521/1067] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:46.585089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f13255-f1dd-4ae1-8895-d37756a70412 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.623699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:46.694336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f13255-f1dd-4ae1-8895-d37756a70412 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.729180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6b159-a748-4f37-950a-0c6854f353d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.729781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6b159-a748-4f37-950a-0c6854f353d7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.730059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6b159-a748-4f37-950a-0c6854f353d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.730325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6b159-a748-4f37-950a-0c6854f353d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.741557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6b159-a748-4f37-950a-0c6854f353d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.743007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6b159-a748-4f37-950a-0c6854f353d7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-2ad6b159-a748-4f37-950a-0c6854f353d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:46.757594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:46.763826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:46.764964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:46.764964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:46.764964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:46.764964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 547/1068] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:46.766500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6795983-2fd9-4283-97e2-c1d220499c68 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.870619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6795983-2fd9-4283-97e2-c1d220499c68 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.905818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e22e9-0e84-42e8-8636-b4ae29f6cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.906432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e22e9-0e84-42e8-8636-b4ae29f6cc9a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.906711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e22e9-0e84-42e8-8636-b4ae29f6cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.907011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e22e9-0e84-42e8-8636-b4ae29f6cc9a None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.907652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e22e9-0e84-42e8-8636-b4ae29f6cc9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:46.907956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e22e9-0e84-42e8-8636-b4ae29f6cc9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.909385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e22e9-0e84-42e8-8636-b4ae29f6cc9a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.926280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 522/1069] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:46.927658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6b159-a748-4f37-950a-0c6854f353d7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:47.019315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:47.033036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6b159-a748-4f37-950a-0c6854f353d7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:47.068971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08293ec-75d9-420a-b14a-d267db041c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:47.069605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08293ec-75d9-420a-b14a-d267db041c37 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.069880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08293ec-75d9-420a-b14a-d267db041c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.070145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08293ec-75d9-420a-b14a-d267db041c37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.072829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc90f-c827-4b49-af57-5f604c4a007f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.073120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc90f-c827-4b49-af57-5f604c4a007f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.073397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc90f-c827-4b49-af57-5f604c4a007f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.074897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 523/1070] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:47.077282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08293ec-75d9-420a-b14a-d267db041c37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:47.078716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08293ec-75d9-420a-b14a-d267db041c37 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:47.079778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0913b-7945-4ad3-93ec-6afb63c48159 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.080129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0913b-7945-4ad3-93ec-6afb63c48159 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.080598 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0913b-7945-4ad3-93ec-6afb63c48159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-d08293ec-75d9-420a-b14a-d267db041c37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:47.091571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:47.092588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:47.093538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:47.093538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:47.093538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:47.093538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:47.093538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:47.093538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:47.093538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:47.093538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:47.094299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 548/1071] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:47.099310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08293ec-75d9-420a-b14a-d267db041c37 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:47.103709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a4e0913b-7945-4ad3-93ec-6afb63c48159 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:47.104983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a4e0913b-7945-4ad3-93ec-6afb63c48159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:47.123776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:47.185065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 524/1072] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:47.212404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08293ec-75d9-420a-b14a-d267db041c37 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:47.247861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74a50a-6786-4492-a0c2-9ab68f85be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:47.248471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74a50a-6786-4492-a0c2-9ab68f85be85 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.248755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74a50a-6786-4492-a0c2-9ab68f85be85 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.249024 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74a50a-6786-4492-a0c2-9ab68f85be85 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.249710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74a50a-6786-4492-a0c2-9ab68f85be85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:47.250016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74a50a-6786-4492-a0c2-9ab68f85be85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:47.251471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74a50a-6786-4492-a0c2-9ab68f85be85 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:47.264673 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 549/1073] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:47.271491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0913b-7945-4ad3-93ec-6afb63c48159 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:47.385419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0913b-7945-4ad3-93ec-6afb63c48159 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:47.420408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181524f-cb8e-447e-8dc3-7f02e7584155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:47.421079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181524f-cb8e-447e-8dc3-7f02e7584155 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.421527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181524f-cb8e-447e-8dc3-7f02e7584155 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.421699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181524f-cb8e-447e-8dc3-7f02e7584155 None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/d6e704b8291b4934a20cdde2ef127493/roles/c798b7c9ae25488d8324caed1ed4a055` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.423039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e5e67-7ee4-40fb-a2ca-f7681e3c18c2 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.423333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e5e67-7ee4-40fb-a2ca-f7681e3c18c2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.423612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e5e67-7ee4-40fb-a2ca-f7681e3c18c2 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.423941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181524f-cb8e-447e-8dc3-7f02e7584155 None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=d6e704b8291b4934a20cdde2ef127493, role_id=c798b7c9ae25488d8324caed1ed4a055)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:47.425259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 550/1074] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:47.425577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181524f-cb8e-447e-8dc3-7f02e7584155 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:47.430311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d1ba-6910-4c52-b58a-7291dc4c5c31 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.430566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d1ba-6910-4c52-b58a-7291dc4c5c31 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.430836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d1ba-6910-4c52-b58a-7291dc4c5c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.448819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 525/1075] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:47 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/d6e704b8291b4934a20cdde2ef127493/roles/c798b7c9ae25488d8324caed1ed4a055 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:35:47.452227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181524f-cb8e-447e-8dc3-7f02e7584155 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:47.458737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8770d1ba-6910-4c52-b58a-7291dc4c5c31 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:47.460655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8770d1ba-6910-4c52-b58a-7291dc4c5c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:47.463471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:47.472338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:47.543902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 551/1076] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:47.582269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181524f-cb8e-447e-8dc3-7f02e7584155 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:47.624052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f0de9-c3f7-4a3f-94f8-a7bdd2c04a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:47.624697 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0de9-c3f7-4a3f-94f8-a7bdd2c04a1a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.624981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0de9-c3f7-4a3f-94f8-a7bdd2c04a1a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.625252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0de9-c3f7-4a3f-94f8-a7bdd2c04a1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.637713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f0de9-c3f7-4a3f-94f8-a7bdd2c04a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-9f9f0de9-c3f7-4a3f-94f8-a7bdd2c04a1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:47.642461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:47.644001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:47.644881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:47.645532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 526/1077] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:47.650683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d1ba-6910-4c52-b58a-7291dc4c5c31 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:47.760830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d1ba-6910-4c52-b58a-7291dc4c5c31 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:47.795374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641ea53-c7ab-4d95-9871-478e1e34ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:47.795862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641ea53-c7ab-4d95-9871-478e1e34ad4d None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.796135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641ea53-c7ab-4d95-9871-478e1e34ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.796402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641ea53-c7ab-4d95-9871-478e1e34ad4d None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.797062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641ea53-c7ab-4d95-9871-478e1e34ad4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:47.797359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641ea53-c7ab-4d95-9871-478e1e34ad4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:47.798714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641ea53-c7ab-4d95-9871-478e1e34ad4d None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:47.804880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:47.810948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 552/1078] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:47.816631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f0de9-c3f7-4a3f-94f8-a7bdd2c04a1a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:47.830084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641ea53-c7ab-4d95-9871-478e1e34ad4d None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:47.897209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:47.931702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f0de9-c3f7-4a3f-94f8-a7bdd2c04a1a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:47.942196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641ea53-c7ab-4d95-9871-478e1e34ad4d None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:47.968542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b288a-3171-4246-b87a-e0e022d84420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:47.969183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b288a-3171-4246-b87a-e0e022d84420 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.969461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b288a-3171-4246-b87a-e0e022d84420 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.969729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b288a-3171-4246-b87a-e0e022d84420 None admin] PATH_INFO: `/v3/users/50f92166d4cc4ebdb651fe3cf0e7d5b6` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.971001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b288a-3171-4246-b87a-e0e022d84420 None admin] RBAC: Authorizing `identity:get_user(user_id=50f92166d4cc4ebdb651fe3cf0e7d5b6)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:47.972324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b288a-3171-4246-b87a-e0e022d84420 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:47.974054 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 527/1079] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:47 2022] GET /identity/v3/users/50f92166d4cc4ebdb651fe3cf0e7d5b6 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:47.979531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b288a-3171-4246-b87a-e0e022d84420 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:47.981691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be974cd3-b6ed-41f0-8781-0a6b2d7e7f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:47.982305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be974cd3-b6ed-41f0-8781-0a6b2d7e7f31 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.982622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be974cd3-b6ed-41f0-8781-0a6b2d7e7f31 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.982888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be974cd3-b6ed-41f0-8781-0a6b2d7e7f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:48.055165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:48.057539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be974cd3-b6ed-41f0-8781-0a6b2d7e7f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:48.059237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be974cd3-b6ed-41f0-8781-0a6b2d7e7f31 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:48.094903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b288a-3171-4246-b87a-e0e022d84420 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:48.135410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195b67-d490-402b-8825-1569041e0d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:48.136153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195b67-d490-402b-8825-1569041e0d5c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:48.136436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195b67-d490-402b-8825-1569041e0d5c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:48.136712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195b67-d490-402b-8825-1569041e0d5c None admin] PATH_INFO: `/v3/projects/04b04b1ca9a84255aad36c7e78aa3713` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:48.137870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87195b67-d490-402b-8825-1569041e0d5c None admin] RBAC: Authorizing `identity:get_project(project_id=04b04b1ca9a84255aad36c7e78aa3713)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:48.139350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87195b67-d490-402b-8825-1569041e0d5c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:48.141211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 528/1080] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:47 2022] GET /identity/v3/projects/04b04b1ca9a84255aad36c7e78aa3713 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:48.146932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195b67-d490-402b-8825-1569041e0d5c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:48.157657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:48.183226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 553/1081] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:35:48.188958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be974cd3-b6ed-41f0-8781-0a6b2d7e7f31 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:48.263891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195b67-d490-402b-8825-1569041e0d5c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:48.291457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:48.296669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be974cd3-b6ed-41f0-8781-0a6b2d7e7f31 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:48.300925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b6c1f-c7af-43fc-b2b1-b9ae4e46f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:48.301602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b6c1f-c7af-43fc-b2b1-b9ae4e46f496 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:48.301881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b6c1f-c7af-43fc-b2b1-b9ae4e46f496 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:48.302152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b6c1f-c7af-43fc-b2b1-b9ae4e46f496 None admin] PATH_INFO: `/v3/projects/04b04b1ca9a84255aad36c7e78aa3713/users/50f92166d4cc4ebdb651fe3cf0e7d5b6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:48.304099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b6c1f-c7af-43fc-b2b1-b9ae4e46f496 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b04b1ca9a84255aad36c7e78aa3713, user_id=50f92166d4cc4ebdb651fe3cf0e7d5b6, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:48.306011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b6c1f-c7af-43fc-b2b1-b9ae4e46f496 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:48.330799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 529/1082] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:48 2022] PUT /identity/v3/projects/04b04b1ca9a84255aad36c7e78aa3713/users/50f92166d4cc4ebdb651fe3cf0e7d5b6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:35:48.335211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407eb6-3082-4a39-923e-220d8ff9bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:48.335882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407eb6-3082-4a39-923e-220d8ff9bb50 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:48.336160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407eb6-3082-4a39-923e-220d8ff9bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:48.336435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407eb6-3082-4a39-923e-220d8ff9bb50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:48.349363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b407eb6-3082-4a39-923e-220d8ff9bb50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:48.350899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b407eb6-3082-4a39-923e-220d8ff9bb50 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-2b407eb6-3082-4a39-923e-220d8ff9bb50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:48.367733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:48.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:48.369680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:48.369680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:48.369680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:48.369680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 554/1083] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:48.375270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b6c1f-c7af-43fc-b2b1-b9ae4e46f496 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:48.455470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:48.497292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b6c1f-c7af-43fc-b2b1-b9ae4e46f496 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:48.535914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c640d1-507b-48e2-a7a5-9cb4ec7fb33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:48.535914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c640d1-507b-48e2-a7a5-9cb4ec7fb33a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:48.535914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c640d1-507b-48e2-a7a5-9cb4ec7fb33a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:48.537123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c640d1-507b-48e2-a7a5-9cb4ec7fb33a None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:48.537123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c640d1-507b-48e2-a7a5-9cb4ec7fb33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:48.537260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c640d1-507b-48e2-a7a5-9cb4ec7fb33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:48.538527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c640d1-507b-48e2-a7a5-9cb4ec7fb33a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:48.551625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 530/1084] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:49.437342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612c8e2-a810-4c36-b40f-22963ee35136 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:49.437906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612c8e2-a810-4c36-b40f-22963ee35136 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:49.437906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612c8e2-a810-4c36-b40f-22963ee35136 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:49.440106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 555/1085] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:49.446148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ba34-8cac-4702-9b8d-06439363c3ec None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:49.446638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ba34-8cac-4702-9b8d-06439363c3ec None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:49.446718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ba34-8cac-4702-9b8d-06439363c3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:49.467570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3a54ba34-8cac-4702-9b8d-06439363c3ec None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:49.468760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3a54ba34-8cac-4702-9b8d-06439363c3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:49.546206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 531/1086] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:49.822132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612c8e2-a810-4c36-b40f-22963ee35136 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:49.942479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612c8e2-a810-4c36-b40f-22963ee35136 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:49.976650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25b7a4-c357-4380-a83d-2fb10215ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:49.977280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25b7a4-c357-4380-a83d-2fb10215ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:49.977554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25b7a4-c357-4380-a83d-2fb10215ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:49.977820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25b7a4-c357-4380-a83d-2fb10215ebe1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:49.990253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25b7a4-c357-4380-a83d-2fb10215ebe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-1f25b7a4-c357-4380-a83d-2fb10215ebe1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:49.994975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:49.995928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:49.996809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 556/1087] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Aug 18 20:35:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:50.003066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54ba34-8cac-4702-9b8d-06439363c3ec None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:50.068449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:50.113356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54ba34-8cac-4702-9b8d-06439363c3ec None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:50.153963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a70abd-cd61-4b4e-bf55-dd48a56408eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:50.154578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a70abd-cd61-4b4e-bf55-dd48a56408eb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:50.154892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a70abd-cd61-4b4e-bf55-dd48a56408eb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:50.155164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a70abd-cd61-4b4e-bf55-dd48a56408eb None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:50.155831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a70abd-cd61-4b4e-bf55-dd48a56408eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:50.156134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a70abd-cd61-4b4e-bf55-dd48a56408eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:50.157514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a70abd-cd61-4b4e-bf55-dd48a56408eb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:50.166479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 532/1088] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:50.172344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25b7a4-c357-4380-a83d-2fb10215ebe1 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:50.188592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:50.287173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25b7a4-c357-4380-a83d-2fb10215ebe1 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:50.323011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a5508-d597-45a1-97ba-9ce3128d61de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:50.323648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5508-d597-45a1-97ba-9ce3128d61de None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:50.323924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5508-d597-45a1-97ba-9ce3128d61de None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:50.324196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5508-d597-45a1-97ba-9ce3128d61de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:50.335803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a5508-d597-45a1-97ba-9ce3128d61de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:50.337251 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a5508-d597-45a1-97ba-9ce3128d61de None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-552a5508-d597-45a1-97ba-9ce3128d61de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:50.351528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:50.353432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:50.355244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:50.355244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:50.355244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:50.355610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc8ae-f6da-4cbc-89f1-70bdd3f9330f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:50.355610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc8ae-f6da-4cbc-89f1-70bdd3f9330f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:50.355610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc8ae-f6da-4cbc-89f1-70bdd3f9330f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:50.355943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 557/1089] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:50.356063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 533/1090] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:50.359417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c52ac-8f60-4e8c-ad69-fe25ee868cbb None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:50.359633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c52ac-8f60-4e8c-ad69-fe25ee868cbb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:50.359916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c52ac-8f60-4e8c-ad69-fe25ee868cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:50.360702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc8ae-f6da-4cbc-89f1-70bdd3f9330f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:50.378954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-fc9c52ac-8f60-4e8c-ad69-fe25ee868cbb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:50.380050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-fc9c52ac-8f60-4e8c-ad69-fe25ee868cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:50.440325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:50.449270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 558/1091] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:50.469438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc8ae-f6da-4cbc-89f1-70bdd3f9330f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:50.490121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:50.505142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c5d08-0bfc-4a2a-8251-528141dfeafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:50.505750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5d08-0bfc-4a2a-8251-528141dfeafc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:50.506030 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5d08-0bfc-4a2a-8251-528141dfeafc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:50.506312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5d08-0bfc-4a2a-8251-528141dfeafc None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:50.506971 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c5d08-0bfc-4a2a-8251-528141dfeafc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:50.507280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c5d08-0bfc-4a2a-8251-528141dfeafc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:50.508897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c5d08-0bfc-4a2a-8251-528141dfeafc None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:50.520753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 534/1092] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:50.526410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c52ac-8f60-4e8c-ad69-fe25ee868cbb None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:50.652567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c52ac-8f60-4e8c-ad69-fe25ee868cbb None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:50.687226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e711e9d-5cfd-48cb-956f-f9f2ccab36a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:50.687874 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e711e9d-5cfd-48cb-956f-f9f2ccab36a1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:50.688136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e711e9d-5cfd-48cb-956f-f9f2ccab36a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:50.688404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e711e9d-5cfd-48cb-956f-f9f2ccab36a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:50.695918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e711e9d-5cfd-48cb-956f-f9f2ccab36a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:50.697350 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e711e9d-5cfd-48cb-956f-f9f2ccab36a1 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-3e711e9d-5cfd-48cb-956f-f9f2ccab36a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:50.710077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:50.711235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:50.712215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 559/1093] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Aug 18 20:35:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:50.717178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c5d08-0bfc-4a2a-8251-528141dfeafc None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:50.718053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e711e9d-5cfd-48cb-956f-f9f2ccab36a1 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:50.778170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:50.824868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c5d08-0bfc-4a2a-8251-528141dfeafc None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:50.825117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e711e9d-5cfd-48cb-956f-f9f2ccab36a1 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:50.861679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a03de6-dffb-4542-a1bf-5e46544d9b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:50.861942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904abdc5-e719-40b5-bdb0-20bd40b95aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:50.862345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904abdc5-e719-40b5-bdb0-20bd40b95aed None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:50.862445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a03de6-dffb-4542-a1bf-5e46544d9b0b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:50.862646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904abdc5-e719-40b5-bdb0-20bd40b95aed None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:50.862745 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a03de6-dffb-4542-a1bf-5e46544d9b0b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:50.862948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904abdc5-e719-40b5-bdb0-20bd40b95aed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:50.863051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a03de6-dffb-4542-a1bf-5e46544d9b0b None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:50.863728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a03de6-dffb-4542-a1bf-5e46544d9b0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:50.864033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a03de6-dffb-4542-a1bf-5e46544d9b0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:50.865736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a03de6-dffb-4542-a1bf-5e46544d9b0b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:50.873969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904abdc5-e719-40b5-bdb0-20bd40b95aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-904abdc5-e719-40b5-bdb0-20bd40b95aed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:50.878744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:50.879989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:35:50.881017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 560/1094] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:50.887272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904abdc5-e719-40b5-bdb0-20bd40b95aed None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:50.893102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 535/1095] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Aug 18 20:35:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:50.899280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a03de6-dffb-4542-a1bf-5e46544d9b0b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:50.945826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:51.004377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904abdc5-e719-40b5-bdb0-20bd40b95aed None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.014278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a03de6-dffb-4542-a1bf-5e46544d9b0b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.019534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:51.041334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70127a8-8be4-4c03-ad48-1d5be8173fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.041943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70127a8-8be4-4c03-ad48-1d5be8173fd7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.042217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70127a8-8be4-4c03-ad48-1d5be8173fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.042485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70127a8-8be4-4c03-ad48-1d5be8173fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.043194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70127a8-8be4-4c03-ad48-1d5be8173fd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:51.043494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70127a8-8be4-4c03-ad48-1d5be8173fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.044852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70127a8-8be4-4c03-ad48-1d5be8173fd7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.055248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 561/1096] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:51.055441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d728-251f-4a73-be0f-09826a917c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.060652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d728-251f-4a73-be0f-09826a917c2b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.060941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d728-251f-4a73-be0f-09826a917c2b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.061076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70127a8-8be4-4c03-ad48-1d5be8173fd7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:51.061219 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d728-251f-4a73-be0f-09826a917c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.129813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d728-251f-4a73-be0f-09826a917c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.131316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d728-251f-4a73-be0f-09826a917c2b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.160781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70127a8-8be4-4c03-ad48-1d5be8173fd7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.180932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:51.200603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ad58-deae-43d3-99da-54defcc77422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.201170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ad58-deae-43d3-99da-54defcc77422 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.201447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ad58-deae-43d3-99da-54defcc77422 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.201713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ad58-deae-43d3-99da-54defcc77422 None admin] PATH_INFO: `/v3/users/50f92166d4cc4ebdb651fe3cf0e7d5b6` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.202936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7ad58-deae-43d3-99da-54defcc77422 None admin] RBAC: Authorizing `identity:get_user(user_id=50f92166d4cc4ebdb651fe3cf0e7d5b6)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.204384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7ad58-deae-43d3-99da-54defcc77422 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.211794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 562/1097] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:51 2022] GET /identity/v3/users/50f92166d4cc4ebdb651fe3cf0e7d5b6 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:51.213074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ad58-deae-43d3-99da-54defcc77422 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:51.250242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 536/1098] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:35:51.257035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d728-251f-4a73-be0f-09826a917c2b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:51.264909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:51.320380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ad58-deae-43d3-99da-54defcc77422 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.355638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179b74e-89f6-4e71-825a-4ef1c9d05ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.356251 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179b74e-89f6-4e71-825a-4ef1c9d05ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.356529 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179b74e-89f6-4e71-825a-4ef1c9d05ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.356842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179b74e-89f6-4e71-825a-4ef1c9d05ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.359651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d728-251f-4a73-be0f-09826a917c2b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.393961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639b23f-e99d-4feb-812a-d836c2a29d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.394591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639b23f-e99d-4feb-812a-d836c2a29d39 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.394908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639b23f-e99d-4feb-812a-d836c2a29d39 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.395180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639b23f-e99d-4feb-812a-d836c2a29d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.402519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:51.406571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639b23f-e99d-4feb-812a-d836c2a29d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.409819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639b23f-e99d-4feb-812a-d836c2a29d39 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-d639b23f-e99d-4feb-812a-d836c2a29d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:51.425069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:51.426137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:51.427461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:51.427461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:51.427461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:51.427461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 537/1099] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:51.430077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179b74e-89f6-4e71-825a-4ef1c9d05ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.431544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179b74e-89f6-4e71-825a-4ef1c9d05ce9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.431827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639b23f-e99d-4feb-812a-d836c2a29d39 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:51.478817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:51.533248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639b23f-e99d-4feb-812a-d836c2a29d39 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.538233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 563/1100] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:51.544161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179b74e-89f6-4e71-825a-4ef1c9d05ce9 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:51.570565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8bd3b-fb22-44b1-be84-70f5ae2452f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.571193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8bd3b-fb22-44b1-be84-70f5ae2452f0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.571470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8bd3b-fb22-44b1-be84-70f5ae2452f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.571738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8bd3b-fb22-44b1-be84-70f5ae2452f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.572369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8bd3b-fb22-44b1-be84-70f5ae2452f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:51.572670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8bd3b-fb22-44b1-be84-70f5ae2452f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.574037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8bd3b-fb22-44b1-be84-70f5ae2452f0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.585796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 538/1101] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:51.592584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8bd3b-fb22-44b1-be84-70f5ae2452f0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:51.644391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:51.651352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179b74e-89f6-4e71-825a-4ef1c9d05ce9 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.685860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3c476-ddc2-4e28-86cf-f72540aec8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.686510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c476-ddc2-4e28-86cf-f72540aec8c6 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.686816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c476-ddc2-4e28-86cf-f72540aec8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.687091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c476-ddc2-4e28-86cf-f72540aec8c6 None admin] PATH_INFO: `/v3/projects/04b04b1ca9a84255aad36c7e78aa3713` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.688207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3c476-ddc2-4e28-86cf-f72540aec8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=04b04b1ca9a84255aad36c7e78aa3713)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.689639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3c476-ddc2-4e28-86cf-f72540aec8c6 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.691300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 564/1102] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:51 2022] GET /identity/v3/projects/04b04b1ca9a84255aad36c7e78aa3713 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:51.696191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8bd3b-fb22-44b1-be84-70f5ae2452f0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.697573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3c476-ddc2-4e28-86cf-f72540aec8c6 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:51.712066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:51.734168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515cfb9-3a9c-4f64-af13-d30ece9ba90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.734727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515cfb9-3a9c-4f64-af13-d30ece9ba90a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.735039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515cfb9-3a9c-4f64-af13-d30ece9ba90a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.735312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515cfb9-3a9c-4f64-af13-d30ece9ba90a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.742455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515cfb9-3a9c-4f64-af13-d30ece9ba90a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.743939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515cfb9-3a9c-4f64-af13-d30ece9ba90a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-7515cfb9-3a9c-4f64-af13-d30ece9ba90a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:51.755853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:51.756838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:51.757796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:51.757796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:51.757796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:51.757796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:51.757796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:51.757796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:51.757796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:51.757796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:35:51.757796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 539/1103] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:51.763028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515cfb9-3a9c-4f64-af13-d30ece9ba90a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:51.802232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3c476-ddc2-4e28-86cf-f72540aec8c6 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.838145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f075bba-c305-4d86-9f87-19d14cd2c09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.838748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f075bba-c305-4d86-9f87-19d14cd2c09f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.839061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f075bba-c305-4d86-9f87-19d14cd2c09f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.839328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f075bba-c305-4d86-9f87-19d14cd2c09f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.840058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f075bba-c305-4d86-9f87-19d14cd2c09f None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=04b04b1ca9a84255aad36c7e78aa3713, user.id=50f92166d4cc4ebdb651fe3cf0e7d5b6) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:51.840365 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f075bba-c305-4d86-9f87-19d14cd2c09f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.841785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f075bba-c305-4d86-9f87-19d14cd2c09f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.848232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 565/1104] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:51 2022] GET /identity/v3/role_assignments?user.id=50f92166d4cc4ebdb651fe3cf0e7d5b6&scope.project.id=04b04b1ca9a84255aad36c7e78aa3713&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:51.874481 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515cfb9-3a9c-4f64-af13-d30ece9ba90a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:51.888316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:51.915567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e4991-0e61-4906-b6dc-c741ed5e7049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:51.916198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e4991-0e61-4906-b6dc-c741ed5e7049 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.916480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e4991-0e61-4906-b6dc-c741ed5e7049 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.916757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e4991-0e61-4906-b6dc-c741ed5e7049 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.917463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e4991-0e61-4906-b6dc-c741ed5e7049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:51.917772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e4991-0e61-4906-b6dc-c741ed5e7049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:51.919277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e4991-0e61-4906-b6dc-c741ed5e7049 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:51.932994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 540/1105] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:51.939020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f075bba-c305-4d86-9f87-19d14cd2c09f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:52.025215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:52.051429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f075bba-c305-4d86-9f87-19d14cd2c09f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:52.085478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8a4bc-cfce-4896-81db-3d355118c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:52.086079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8a4bc-cfce-4896-81db-3d355118c223 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:52.086356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8a4bc-cfce-4896-81db-3d355118c223 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:52.086625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8a4bc-cfce-4896-81db-3d355118c223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:52.087370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8a4bc-cfce-4896-81db-3d355118c223 None admin] RBAC: Adding query filter params (role.id=c798b7c9ae25488d8324caed1ed4a055, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=d6e704b8291b4934a20cdde2ef127493) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:52.087679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8a4bc-cfce-4896-81db-3d355118c223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:52.089089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8a4bc-cfce-4896-81db-3d355118c223 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:52.095122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 566/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:51 2022] GET /identity/v3/role_assignments?user.id=d6e704b8291b4934a20cdde2ef127493&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=c798b7c9ae25488d8324caed1ed4a055 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:53.845177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8adfd5-b265-42ff-826e-f4ea6c2f841e None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:53.846182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8adfd5-b265-42ff-826e-f4ea6c2f841e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:53.846182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8adfd5-b265-42ff-826e-f4ea6c2f841e None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:53.847194 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 541/1107] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:53.852403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef1a4-2fec-4ead-af6e-94ddc38df8bf None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:53.852872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef1a4-2fec-4ead-af6e-94ddc38df8bf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:53.852974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef1a4-2fec-4ead-af6e-94ddc38df8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:53.871292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-663ef1a4-2fec-4ead-af6e-94ddc38df8bf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:53.872471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-663ef1a4-2fec-4ead-af6e-94ddc38df8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:53.937990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 567/1108] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:54.205897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8adfd5-b265-42ff-826e-f4ea6c2f841e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:54.307195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8adfd5-b265-42ff-826e-f4ea6c2f841e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:54.339914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835ac43-e9cf-4653-8ee6-f3bbec87e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:54.340540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835ac43-e9cf-4653-8ee6-f3bbec87e11d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:54.340819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835ac43-e9cf-4653-8ee6-f3bbec87e11d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:54.341089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835ac43-e9cf-4653-8ee6-f3bbec87e11d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:54.342189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835ac43-e9cf-4653-8ee6-f3bbec87e11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:54.343648 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835ac43-e9cf-4653-8ee6-f3bbec87e11d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:54.345196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 542/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:54.351663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ef1a4-2fec-4ead-af6e-94ddc38df8bf None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:54.418554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:54.448638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ef1a4-2fec-4ead-af6e-94ddc38df8bf None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:54.480610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dc5d1-ca11-4682-ba19-285cd50fcc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:54.481139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dc5d1-ca11-4682-ba19-285cd50fcc75 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:54.481412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dc5d1-ca11-4682-ba19-285cd50fcc75 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:54.481681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dc5d1-ca11-4682-ba19-285cd50fcc75 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:54.482320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dc5d1-ca11-4682-ba19-285cd50fcc75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:54.483759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dc5d1-ca11-4682-ba19-285cd50fcc75 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:54.508195 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 568/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:35:54 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:56.506741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6e5cb-9b52-4ea0-953e-72e39ed8a3c7 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:56.507336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6e5cb-9b52-4ea0-953e-72e39ed8a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:56.507336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6e5cb-9b52-4ea0-953e-72e39ed8a3c7 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:56.508891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 543/1111] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:56.513984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09580b0-b511-4fc7-a87a-82bc54c38e98 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:56.514381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09580b0-b511-4fc7-a87a-82bc54c38e98 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:56.514527 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09580b0-b511-4fc7-a87a-82bc54c38e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:56.532244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b09580b0-b511-4fc7-a87a-82bc54c38e98 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:56.533948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b09580b0-b511-4fc7-a87a-82bc54c38e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:56.602248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 569/1112] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:56.871951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6e5cb-9b52-4ea0-953e-72e39ed8a3c7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:56.914001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:56.973465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6e5cb-9b52-4ea0-953e-72e39ed8a3c7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:57.006240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788ae91-4a5a-4214-84c7-979f2c460723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:57.006895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788ae91-4a5a-4214-84c7-979f2c460723 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:57.007178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788ae91-4a5a-4214-84c7-979f2c460723 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:57.007453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788ae91-4a5a-4214-84c7-979f2c460723 None admin] PATH_INFO: `/v3/roles/597a1ee9b8e047e4b63712515f4994f0` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:57.009080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788ae91-4a5a-4214-84c7-979f2c460723 None admin] RBAC: Authorizing `identity:get_role(role_id=597a1ee9b8e047e4b63712515f4994f0)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:57.010451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788ae91-4a5a-4214-84c7-979f2c460723 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:57.011798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 544/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:56 2022] GET /identity/v3/roles/597a1ee9b8e047e4b63712515f4994f0 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:57.018290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09580b0-b511-4fc7-a87a-82bc54c38e98 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:57.077636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:57.120979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09580b0-b511-4fc7-a87a-82bc54c38e98 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:57.155281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34889955-e9d9-4948-8ec7-a08ce2e3e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:57.155849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34889955-e9d9-4948-8ec7-a08ce2e3e221 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:57.156131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34889955-e9d9-4948-8ec7-a08ce2e3e221 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:57.156403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34889955-e9d9-4948-8ec7-a08ce2e3e221 None admin] PATH_INFO: `/v3/users/a9772563bf5d45778e38b86c4cd23787` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:57.169973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34889955-e9d9-4948-8ec7-a08ce2e3e221 None admin] RBAC: Authorizing `identity:get_user(user_id=a9772563bf5d45778e38b86c4cd23787)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:57.171442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34889955-e9d9-4948-8ec7-a08ce2e3e221 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:57.173060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 570/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:57 2022] GET /identity/v3/users/a9772563bf5d45778e38b86c4cd23787 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:57.179624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788ae91-4a5a-4214-84c7-979f2c460723 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:57.280799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788ae91-4a5a-4214-84c7-979f2c460723 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:57.288259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:57.315617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c98fd-0232-40bb-8b8d-92e08b454763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:57.316215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c98fd-0232-40bb-8b8d-92e08b454763 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:57.316498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c98fd-0232-40bb-8b8d-92e08b454763 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:57.316803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c98fd-0232-40bb-8b8d-92e08b454763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:57.383958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c98fd-0232-40bb-8b8d-92e08b454763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:57.385401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c98fd-0232-40bb-8b8d-92e08b454763 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:57.490895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 545/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:57.496992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34889955-e9d9-4948-8ec7-a08ce2e3e221 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:57.594788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34889955-e9d9-4948-8ec7-a08ce2e3e221 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:57.610060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:57.630285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21b805-2db6-4de7-b084-1ba0ba411c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:57.630940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21b805-2db6-4de7-b084-1ba0ba411c74 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:57.631213 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21b805-2db6-4de7-b084-1ba0ba411c74 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:57.631478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21b805-2db6-4de7-b084-1ba0ba411c74 None admin] PATH_INFO: `/v3/projects/04b04b1ca9a84255aad36c7e78aa3713` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:57.632565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21b805-2db6-4de7-b084-1ba0ba411c74 None admin] RBAC: Authorizing `identity:get_project(project_id=04b04b1ca9a84255aad36c7e78aa3713)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:57.634233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21b805-2db6-4de7-b084-1ba0ba411c74 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:57.635872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 571/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:57 2022] GET /identity/v3/projects/04b04b1ca9a84255aad36c7e78aa3713 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:57.643276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c98fd-0232-40bb-8b8d-92e08b454763 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:57.651509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:57.742122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c98fd-0232-40bb-8b8d-92e08b454763 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:57.775524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57477198-9306-4bad-884f-473954f63685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:57.776128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57477198-9306-4bad-884f-473954f63685 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:57.776409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57477198-9306-4bad-884f-473954f63685 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:57.776682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57477198-9306-4bad-884f-473954f63685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:57.777401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57477198-9306-4bad-884f-473954f63685 None admin] RBAC: Adding query filter params (role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=04b04b1ca9a84255aad36c7e78aa3713, user.id=a9772563bf5d45778e38b86c4cd23787) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:57.777709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57477198-9306-4bad-884f-473954f63685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:57.779170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57477198-9306-4bad-884f-473954f63685 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:57.784435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 546/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:57 2022] GET /identity/v3/role_assignments?user.id=a9772563bf5d45778e38b86c4cd23787&scope.project.id=04b04b1ca9a84255aad36c7e78aa3713&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:59.680912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0d02f-3ad1-4f15-87c1-a18e0234b874 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:59.681452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0d02f-3ad1-4f15-87c1-a18e0234b874 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:59.681452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0d02f-3ad1-4f15-87c1-a18e0234b874 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:59.682827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 572/1118] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:59.688026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa52b9-8763-4c05-8cf3-51a17107756c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:59.688403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa52b9-8763-4c05-8cf3-51a17107756c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:59.688578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa52b9-8763-4c05-8cf3-51a17107756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:59.706796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2ffa52b9-8763-4c05-8cf3-51a17107756c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:59.708114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2ffa52b9-8763-4c05-8cf3-51a17107756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:59.770066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:59.775291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 547/1119] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:00.044885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0d02f-3ad1-4f15-87c1-a18e0234b874 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:00.146042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0d02f-3ad1-4f15-87c1-a18e0234b874 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:00.180291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436153bf-0d54-4da6-8f83-1e2015f329d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:00.180917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436153bf-0d54-4da6-8f83-1e2015f329d5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:00.181194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436153bf-0d54-4da6-8f83-1e2015f329d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:00.181463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436153bf-0d54-4da6-8f83-1e2015f329d5 None admin] PATH_INFO: `/v3/roles/597a1ee9b8e047e4b63712515f4994f0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:00.182933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436153bf-0d54-4da6-8f83-1e2015f329d5 None admin] RBAC: Authorizing `identity:get_role(role_id=597a1ee9b8e047e4b63712515f4994f0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:00.184293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436153bf-0d54-4da6-8f83-1e2015f329d5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:00.185620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 573/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:00 2022] GET /identity/v3/roles/597a1ee9b8e047e4b63712515f4994f0 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:00.191712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa52b9-8763-4c05-8cf3-51a17107756c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:00.289484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa52b9-8763-4c05-8cf3-51a17107756c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:00.322829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047671b-3678-4647-a981-91046c90f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:00.323391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047671b-3678-4647-a981-91046c90f939 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:00.323666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047671b-3678-4647-a981-91046c90f939 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:00.323934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047671b-3678-4647-a981-91046c90f939 None admin] PATH_INFO: `/v3/users/a9772563bf5d45778e38b86c4cd23787` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:00.325022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047671b-3678-4647-a981-91046c90f939 None admin] RBAC: Authorizing `identity:get_user(user_id=a9772563bf5d45778e38b86c4cd23787)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:00.326454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047671b-3678-4647-a981-91046c90f939 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:00.328035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 548/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:00 2022] GET /identity/v3/users/a9772563bf5d45778e38b86c4cd23787 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:00.334176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436153bf-0d54-4da6-8f83-1e2015f329d5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:00.390094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:00.441182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436153bf-0d54-4da6-8f83-1e2015f329d5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:00.475378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2c66b-ae98-40ea-82d7-a6cea1110606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:00.476002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2c66b-ae98-40ea-82d7-a6cea1110606 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:00.476282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2c66b-ae98-40ea-82d7-a6cea1110606 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:00.476554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2c66b-ae98-40ea-82d7-a6cea1110606 None admin] PATH_INFO: `/v3/projects/04b04b1ca9a84255aad36c7e78aa3713` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:00.477653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2c66b-ae98-40ea-82d7-a6cea1110606 None admin] RBAC: Authorizing `identity:get_project(project_id=04b04b1ca9a84255aad36c7e78aa3713)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:00.479094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2c66b-ae98-40ea-82d7-a6cea1110606 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:00.480727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 574/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:00 2022] GET /identity/v3/projects/04b04b1ca9a84255aad36c7e78aa3713 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:00.487147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047671b-3678-4647-a981-91046c90f939 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:00.554144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:00.589917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047671b-3678-4647-a981-91046c90f939 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:00.623787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f0362-ce0e-4210-9610-c510d591ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:00.624467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f0362-ce0e-4210-9610-c510d591ef35 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:00.624719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f0362-ce0e-4210-9610-c510d591ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:00.624993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f0362-ce0e-4210-9610-c510d591ef35 None admin] PATH_INFO: `/v3/projects/04b04b1ca9a84255aad36c7e78aa3713/users/a9772563bf5d45778e38b86c4cd23787/roles/597a1ee9b8e047e4b63712515f4994f0` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:00.627633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f0362-ce0e-4210-9610-c510d591ef35 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b04b1ca9a84255aad36c7e78aa3713, user_id=a9772563bf5d45778e38b86c4cd23787, role_id=597a1ee9b8e047e4b63712515f4994f0)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:00.629068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f0362-ce0e-4210-9610-c510d591ef35 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:00.643569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 549/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:36:00 2022] PUT /identity/v3/projects/04b04b1ca9a84255aad36c7e78aa3713/users/a9772563bf5d45778e38b86c4cd23787/roles/597a1ee9b8e047e4b63712515f4994f0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:36:02.563553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a364ae-7681-4f19-967d-273383cd1fe7 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:02.564667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a364ae-7681-4f19-967d-273383cd1fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:02.564667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a364ae-7681-4f19-967d-273383cd1fe7 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:02.565993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 575/1124] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:02.571347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2ea3-2afe-4fa9-a6c1-026e3c71940e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:02.571754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2ea3-2afe-4fa9-a6c1-026e3c71940e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:02.571922 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2ea3-2afe-4fa9-a6c1-026e3c71940e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:02.590695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-301f2ea3-2afe-4fa9-a6c1-026e3c71940e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:02.591912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-301f2ea3-2afe-4fa9-a6c1-026e3c71940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:02.660816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 550/1125] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:02.925934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a364ae-7681-4f19-967d-273383cd1fe7 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:03.027054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a364ae-7681-4f19-967d-273383cd1fe7 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:03.044848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:03.062347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039b920-6d39-457f-bddd-aed74be77530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:03.063019 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039b920-6d39-457f-bddd-aed74be77530 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:03.063300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039b920-6d39-457f-bddd-aed74be77530 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:03.063575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039b920-6d39-457f-bddd-aed74be77530 None admin] PATH_INFO: `/v3/roles/597a1ee9b8e047e4b63712515f4994f0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:03.065324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039b920-6d39-457f-bddd-aed74be77530 None admin] RBAC: Authorizing `identity:get_role(role_id=597a1ee9b8e047e4b63712515f4994f0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:03.066694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039b920-6d39-457f-bddd-aed74be77530 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:03.068059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 576/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:02 2022] GET /identity/v3/roles/597a1ee9b8e047e4b63712515f4994f0 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:03.073946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2ea3-2afe-4fa9-a6c1-026e3c71940e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:03.132591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:03.176541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2ea3-2afe-4fa9-a6c1-026e3c71940e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:03.210152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcc247-ccb5-4061-94b7-4956c5376e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:03.210802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcc247-ccb5-4061-94b7-4956c5376e71 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:03.211091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcc247-ccb5-4061-94b7-4956c5376e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:03.211368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcc247-ccb5-4061-94b7-4956c5376e71 None admin] PATH_INFO: `/v3/users/a9772563bf5d45778e38b86c4cd23787` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:03.212484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcc247-ccb5-4061-94b7-4956c5376e71 None admin] RBAC: Authorizing `identity:get_user(user_id=a9772563bf5d45778e38b86c4cd23787)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:03.213925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcc247-ccb5-4061-94b7-4956c5376e71 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:03.215537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 551/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:03 2022] GET /identity/v3/users/a9772563bf5d45778e38b86c4cd23787 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:03.222112 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039b920-6d39-457f-bddd-aed74be77530 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:03.320501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039b920-6d39-457f-bddd-aed74be77530 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:03.356281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4307aa4-05a7-47cb-8418-d74581319a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:03.357242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4307aa4-05a7-47cb-8418-d74581319a96 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:03.357732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4307aa4-05a7-47cb-8418-d74581319a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:03.358238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4307aa4-05a7-47cb-8418-d74581319a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:03.421267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:03.434992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4307aa4-05a7-47cb-8418-d74581319a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:03.436390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4307aa4-05a7-47cb-8418-d74581319a96 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:03.545590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 577/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:36:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:36:03.551574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcc247-ccb5-4061-94b7-4956c5376e71 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:03.651501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcc247-ccb5-4061-94b7-4956c5376e71 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:03.676461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:03.685369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cea97-c71e-4352-9b3a-a62e165c324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:03.685941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cea97-c71e-4352-9b3a-a62e165c324c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:03.686218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cea97-c71e-4352-9b3a-a62e165c324c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:03.686490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cea97-c71e-4352-9b3a-a62e165c324c None admin] PATH_INFO: `/v3/projects/04b04b1ca9a84255aad36c7e78aa3713` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:03.687635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cea97-c71e-4352-9b3a-a62e165c324c None admin] RBAC: Authorizing `identity:get_project(project_id=04b04b1ca9a84255aad36c7e78aa3713)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:03.689103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cea97-c71e-4352-9b3a-a62e165c324c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:03.690718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 552/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:03 2022] GET /identity/v3/projects/04b04b1ca9a84255aad36c7e78aa3713 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:03.697073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4307aa4-05a7-47cb-8418-d74581319a96 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:03.784888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:03.801069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4307aa4-05a7-47cb-8418-d74581319a96 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:03.834153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb2978-0d7c-4b42-970b-be276b8ddcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:03.834749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb2978-0d7c-4b42-970b-be276b8ddcf8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:03.835053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb2978-0d7c-4b42-970b-be276b8ddcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:03.835321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb2978-0d7c-4b42-970b-be276b8ddcf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:03.836036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb2978-0d7c-4b42-970b-be276b8ddcf8 None admin] RBAC: Adding query filter params (role.id=597a1ee9b8e047e4b63712515f4994f0, scope.project.id=04b04b1ca9a84255aad36c7e78aa3713, user.id=a9772563bf5d45778e38b86c4cd23787) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:03.836339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb2978-0d7c-4b42-970b-be276b8ddcf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:03.837747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb2978-0d7c-4b42-970b-be276b8ddcf8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:03.843364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 578/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:36:03 2022] GET /identity/v3/role_assignments?user.id=a9772563bf5d45778e38b86c4cd23787&scope.project.id=04b04b1ca9a84255aad36c7e78aa3713&role.id=597a1ee9b8e047e4b63712515f4994f0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:05.821910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749b578-2868-4dc8-89aa-cd6f9340cbb4 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:05.822458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749b578-2868-4dc8-89aa-cd6f9340cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:05.822458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749b578-2868-4dc8-89aa-cd6f9340cbb4 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:05.823837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 553/1131] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:05.829050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa00310-cccc-47c2-9cef-df157f859b95 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:05.829706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa00310-cccc-47c2-9cef-df157f859b95 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:05.830139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa00310-cccc-47c2-9cef-df157f859b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:05.848236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-dfa00310-cccc-47c2-9cef-df157f859b95 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:05.849364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-dfa00310-cccc-47c2-9cef-df157f859b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:05.916017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 579/1132] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:06.200869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749b578-2868-4dc8-89aa-cd6f9340cbb4 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:06.302443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749b578-2868-4dc8-89aa-cd6f9340cbb4 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:06.334433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45cca3-4a57-45e9-8eee-aef2af49a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:06.335075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cca3-4a57-45e9-8eee-aef2af49a32a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:06.335351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cca3-4a57-45e9-8eee-aef2af49a32a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:06.335645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cca3-4a57-45e9-8eee-aef2af49a32a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:06.336698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45cca3-4a57-45e9-8eee-aef2af49a32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:06.338125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45cca3-4a57-45e9-8eee-aef2af49a32a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:06.339716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 554/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:36:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:06.346429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa00310-cccc-47c2-9cef-df157f859b95 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:06.426926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:06.446369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa00310-cccc-47c2-9cef-df157f859b95 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:06.480171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317f281-22c2-4100-90db-e3de84f217a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:06.480709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317f281-22c2-4100-90db-e3de84f217a7 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:06.480988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317f281-22c2-4100-90db-e3de84f217a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:06.481255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317f281-22c2-4100-90db-e3de84f217a7 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:06.481883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317f281-22c2-4100-90db-e3de84f217a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:06.483340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317f281-22c2-4100-90db-e3de84f217a7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:06.511075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 580/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:36:06 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:36:08.425505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b137e-4c32-472b-90ed-21fbb350e60d None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:08.426047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b137e-4c32-472b-90ed-21fbb350e60d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:08.426047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b137e-4c32-472b-90ed-21fbb350e60d None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:08.427432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 555/1135] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:36:08.432846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe1b25-60b5-4b6f-a414-5b890e2a7590 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:08.433265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe1b25-60b5-4b6f-a414-5b890e2a7590 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:08.433395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe1b25-60b5-4b6f-a414-5b890e2a7590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:08.451439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-2dbe1b25-60b5-4b6f-a414-5b890e2a7590 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:08.452634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2dbe1b25-60b5-4b6f-a414-5b890e2a7590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:08.521508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 581/1136] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:08.793191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b137e-4c32-472b-90ed-21fbb350e60d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:08.866831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:08.908332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b137e-4c32-472b-90ed-21fbb350e60d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:08.942206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c815e2-d4c8-4760-acfa-d7c70c484ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:08.942856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c815e2-d4c8-4760-acfa-d7c70c484ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:08.943139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c815e2-d4c8-4760-acfa-d7c70c484ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:08.943410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c815e2-d4c8-4760-acfa-d7c70c484ce6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:08.944520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c815e2-d4c8-4760-acfa-d7c70c484ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:08.945954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c815e2-d4c8-4760-acfa-d7c70c484ce6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:08.947556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 556/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:36:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:08.953294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe1b25-60b5-4b6f-a414-5b890e2a7590 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:09.014139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:09.055992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe1b25-60b5-4b6f-a414-5b890e2a7590 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:09.089369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a7487-0f8b-40bb-b47b-148f54dd9d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:09.089973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a7487-0f8b-40bb-b47b-148f54dd9d02 None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:09.090250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a7487-0f8b-40bb-b47b-148f54dd9d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:09.090520 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a7487-0f8b-40bb-b47b-148f54dd9d02 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:09.091198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a7487-0f8b-40bb-b47b-148f54dd9d02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:09.092628 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a7487-0f8b-40bb-b47b-148f54dd9d02 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:09.114185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 582/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:36:08 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:36:11.046893 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae0b76-730c-425a-b4d5-9b4d4e51776e None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:11.047449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae0b76-730c-425a-b4d5-9b4d4e51776e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:11.047449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae0b76-730c-425a-b4d5-9b4d4e51776e None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:11.049515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 557/1139] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:11.055029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acc2a9-d8e4-4e2b-aeaa-bc9db7d958cf None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:11.055457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acc2a9-d8e4-4e2b-aeaa-bc9db7d958cf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:11.055576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acc2a9-d8e4-4e2b-aeaa-bc9db7d958cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:11.073983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-34acc2a9-d8e4-4e2b-aeaa-bc9db7d958cf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:11.075195 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-34acc2a9-d8e4-4e2b-aeaa-bc9db7d958cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:11.140358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 583/1140] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:11.406263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae0b76-730c-425a-b4d5-9b4d4e51776e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:11.507155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae0b76-730c-425a-b4d5-9b4d4e51776e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:11.540910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:11.547290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de007d-1a42-4ee0-aeab-5de25a130345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:11.548066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de007d-1a42-4ee0-aeab-5de25a130345 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:11.548350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de007d-1a42-4ee0-aeab-5de25a130345 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:11.548653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de007d-1a42-4ee0-aeab-5de25a130345 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:11.561051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de007d-1a42-4ee0-aeab-5de25a130345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-40de007d-1a42-4ee0-aeab-5de25a130345 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:36:11.569374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:11.570635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:36:11.571789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 558/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:36:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:11.576622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acc2a9-d8e4-4e2b-aeaa-bc9db7d958cf None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:11.626594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:11.678631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acc2a9-d8e4-4e2b-aeaa-bc9db7d958cf None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:11.712550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e39fe-8383-443f-9af9-c6475ac88c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:11.713119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e39fe-8383-443f-9af9-c6475ac88c56 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:11.713400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e39fe-8383-443f-9af9-c6475ac88c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:11.713669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e39fe-8383-443f-9af9-c6475ac88c56 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:11.714330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e39fe-8383-443f-9af9-c6475ac88c56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:11.714635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e39fe-8383-443f-9af9-c6475ac88c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:11.716024 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e39fe-8383-443f-9af9-c6475ac88c56 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:11.724716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 584/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:36:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:11.730614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de007d-1a42-4ee0-aeab-5de25a130345 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:11.836398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de007d-1a42-4ee0-aeab-5de25a130345 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:11.871861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5862-09fc-44a5-b2a2-811b59765895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:11.872491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5862-09fc-44a5-b2a2-811b59765895 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:11.872772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5862-09fc-44a5-b2a2-811b59765895 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:11.873047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5862-09fc-44a5-b2a2-811b59765895 None admin] PATH_INFO: `/v3/users/ea186f897bdd4196a21316b7daf5e2d2` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:11.887075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5862-09fc-44a5-b2a2-811b59765895 None admin] RBAC: Authorizing `identity:get_user(user_id=ea186f897bdd4196a21316b7daf5e2d2)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:11.888551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5862-09fc-44a5-b2a2-811b59765895 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:11.890215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 559/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:11 2022] GET /identity/v3/users/ea186f897bdd4196a21316b7daf5e2d2 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:11.896750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e39fe-8383-443f-9af9-c6475ac88c56 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:11.996910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e39fe-8383-443f-9af9-c6475ac88c56 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:12.007493 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:12.031366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97421e-cd66-41be-a6f6-a8de06930427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:12.031970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97421e-cd66-41be-a6f6-a8de06930427 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:12.032787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97421e-cd66-41be-a6f6-a8de06930427 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:12.033055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97421e-cd66-41be-a6f6-a8de06930427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:12.101230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97421e-cd66-41be-a6f6-a8de06930427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:12.102674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97421e-cd66-41be-a6f6-a8de06930427 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:12.202068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 585/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:36:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:36:12.208722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5862-09fc-44a5-b2a2-811b59765895 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:12.258833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:12.308861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5862-09fc-44a5-b2a2-811b59765895 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:12.341796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c68d5f-14dd-42a6-ad21-b1ea98275d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:12.342419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c68d5f-14dd-42a6-ad21-b1ea98275d92 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:12.342701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c68d5f-14dd-42a6-ad21-b1ea98275d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:12.343005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c68d5f-14dd-42a6-ad21-b1ea98275d92 None admin] PATH_INFO: `/v3/projects/97244195d0fb4db0a25fc7f1b7b72caf` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:12.344110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c68d5f-14dd-42a6-ad21-b1ea98275d92 None admin] RBAC: Authorizing `identity:get_project(project_id=97244195d0fb4db0a25fc7f1b7b72caf)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:12.346266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c68d5f-14dd-42a6-ad21-b1ea98275d92 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:12.347926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 560/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:12 2022] GET /identity/v3/projects/97244195d0fb4db0a25fc7f1b7b72caf => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:12.354244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97421e-cd66-41be-a6f6-a8de06930427 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:12.366448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:12.455943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97421e-cd66-41be-a6f6-a8de06930427 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:12.490277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332dfd-7869-4f5f-aaf6-50a60dcc0870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:12.490903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332dfd-7869-4f5f-aaf6-50a60dcc0870 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:12.491186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332dfd-7869-4f5f-aaf6-50a60dcc0870 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:12.491457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332dfd-7869-4f5f-aaf6-50a60dcc0870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:12.492193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332dfd-7869-4f5f-aaf6-50a60dcc0870 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=97244195d0fb4db0a25fc7f1b7b72caf, user.id=ea186f897bdd4196a21316b7daf5e2d2) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:12.492481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332dfd-7869-4f5f-aaf6-50a60dcc0870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:12.493896 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332dfd-7869-4f5f-aaf6-50a60dcc0870 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:12.499294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 586/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:36:12 2022] GET /identity/v3/role_assignments?user.id=ea186f897bdd4196a21316b7daf5e2d2&scope.project.id=97244195d0fb4db0a25fc7f1b7b72caf&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:14.390448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cbfc3-5b24-4165-8321-751bb7107aa3 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:14.391057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cbfc3-5b24-4165-8321-751bb7107aa3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:14.391057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cbfc3-5b24-4165-8321-751bb7107aa3 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:14.392898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 561/1147] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:14.398188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8ba6-4d42-46b8-82b1-26a637aec827 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:14.398637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8ba6-4d42-46b8-82b1-26a637aec827 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:14.398827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8ba6-4d42-46b8-82b1-26a637aec827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:14.417016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-37bb8ba6-4d42-46b8-82b1-26a637aec827 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:14.418204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-37bb8ba6-4d42-46b8-82b1-26a637aec827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:14.483113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 587/1148] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:14.754581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cbfc3-5b24-4165-8321-751bb7107aa3 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:14.855248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cbfc3-5b24-4165-8321-751bb7107aa3 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:14.871787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:14.891080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b823-32df-401e-b3c2-334eb9bf3e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:14.891749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b823-32df-401e-b3c2-334eb9bf3e33 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:14.892039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b823-32df-401e-b3c2-334eb9bf3e33 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:14.892311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b823-32df-401e-b3c2-334eb9bf3e33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:14.902548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466b823-32df-401e-b3c2-334eb9bf3e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-c466b823-32df-401e-b3c2-334eb9bf3e33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:36:14.907330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:14.908827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:36:14.909943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 562/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:14.914592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8ba6-4d42-46b8-82b1-26a637aec827 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:14.917722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:15.012968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8ba6-4d42-46b8-82b1-26a637aec827 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:15.046843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43317ff-f43a-4cdd-aaaf-e2796fa2f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:15.047450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43317ff-f43a-4cdd-aaaf-e2796fa2f27c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:15.048275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43317ff-f43a-4cdd-aaaf-e2796fa2f27c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:15.048548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43317ff-f43a-4cdd-aaaf-e2796fa2f27c None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:15.049207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43317ff-f43a-4cdd-aaaf-e2796fa2f27c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:15.049516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43317ff-f43a-4cdd-aaaf-e2796fa2f27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:15.050897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43317ff-f43a-4cdd-aaaf-e2796fa2f27c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:15.058792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 588/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:15.065361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b823-32df-401e-b3c2-334eb9bf3e33 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:15.168550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b823-32df-401e-b3c2-334eb9bf3e33 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:15.203085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c7cb7-6112-4510-ad21-1a7a9d1c4e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:15.203726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c7cb7-6112-4510-ad21-1a7a9d1c4e60 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:15.204509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c7cb7-6112-4510-ad21-1a7a9d1c4e60 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:15.204786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c7cb7-6112-4510-ad21-1a7a9d1c4e60 None admin] PATH_INFO: `/v3/users/ea186f897bdd4196a21316b7daf5e2d2` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:15.205908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c7cb7-6112-4510-ad21-1a7a9d1c4e60 None admin] RBAC: Authorizing `identity:get_user(user_id=ea186f897bdd4196a21316b7daf5e2d2)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:15.207387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c7cb7-6112-4510-ad21-1a7a9d1c4e60 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:15.208967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 563/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:15 2022] GET /identity/v3/users/ea186f897bdd4196a21316b7daf5e2d2 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:15.214820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43317ff-f43a-4cdd-aaaf-e2796fa2f27c None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:15.280107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:15.315255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43317ff-f43a-4cdd-aaaf-e2796fa2f27c None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:15.348323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a242-8ab9-4b8b-964e-b233f0692853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:15.349218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a242-8ab9-4b8b-964e-b233f0692853 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:15.349495 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a242-8ab9-4b8b-964e-b233f0692853 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:15.349763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a242-8ab9-4b8b-964e-b233f0692853 None admin] PATH_INFO: `/v3/projects/97244195d0fb4db0a25fc7f1b7b72caf` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:15.350893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9a242-8ab9-4b8b-964e-b233f0692853 None admin] RBAC: Authorizing `identity:get_project(project_id=97244195d0fb4db0a25fc7f1b7b72caf)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:15.352317 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9a242-8ab9-4b8b-964e-b233f0692853 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:15.353941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 589/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:15 2022] GET /identity/v3/projects/97244195d0fb4db0a25fc7f1b7b72caf => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:15.360587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c7cb7-6112-4510-ad21-1a7a9d1c4e60 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:15.406591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:15.461136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c7cb7-6112-4510-ad21-1a7a9d1c4e60 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:15.494962 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2d583-f681-4108-b3f7-f66f8fb8923c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:15.495602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2d583-f681-4108-b3f7-f66f8fb8923c None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:15.495880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2d583-f681-4108-b3f7-f66f8fb8923c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:15.496149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2d583-f681-4108-b3f7-f66f8fb8923c None admin] PATH_INFO: `/v3/projects/97244195d0fb4db0a25fc7f1b7b72caf/users/ea186f897bdd4196a21316b7daf5e2d2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:15.497994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2d583-f681-4108-b3f7-f66f8fb8923c None admin] RBAC: Authorizing `identity:create_grant(project_id=97244195d0fb4db0a25fc7f1b7b72caf, user_id=ea186f897bdd4196a21316b7daf5e2d2, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:15.499486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2d583-f681-4108-b3f7-f66f8fb8923c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:15.512280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 564/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:36:15 2022] PUT /identity/v3/projects/97244195d0fb4db0a25fc7f1b7b72caf/users/ea186f897bdd4196a21316b7daf5e2d2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:36:17.390799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6489b1-8c4c-4f4e-b2dc-bb44811fafab None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:17.391337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6489b1-8c4c-4f4e-b2dc-bb44811fafab None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:17.391427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6489b1-8c4c-4f4e-b2dc-bb44811fafab None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:17.393271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 590/1154] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:17.398611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15a93e-cb67-43a5-8b21-746289c0c259 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:17.399111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15a93e-cb67-43a5-8b21-746289c0c259 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:17.399208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15a93e-cb67-43a5-8b21-746289c0c259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:17.417285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-dc15a93e-cb67-43a5-8b21-746289c0c259 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:17.418487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-dc15a93e-cb67-43a5-8b21-746289c0c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:17.493132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 565/1155] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:17.773440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6489b1-8c4c-4f4e-b2dc-bb44811fafab None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:17.874005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6489b1-8c4c-4f4e-b2dc-bb44811fafab None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:17.908060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5c9a0-4fe2-4b77-8563-a66fa68efb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:17.908686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5c9a0-4fe2-4b77-8563-a66fa68efb60 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:17.908965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5c9a0-4fe2-4b77-8563-a66fa68efb60 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:17.909235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5c9a0-4fe2-4b77-8563-a66fa68efb60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:17.911106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:17.920638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5c9a0-4fe2-4b77-8563-a66fa68efb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-e1c5c9a0-4fe2-4b77-8563-a66fa68efb60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:36:17.925864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:17.927079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:36:17.928164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 591/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:36:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:17.933078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15a93e-cb67-43a5-8b21-746289c0c259 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:17.968613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:18.036619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15a93e-cb67-43a5-8b21-746289c0c259 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:18.071893 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3282ed-43fc-480b-b546-0599070dfb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:18.072502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3282ed-43fc-480b-b546-0599070dfb83 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:18.072781 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3282ed-43fc-480b-b546-0599070dfb83 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:18.073049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3282ed-43fc-480b-b546-0599070dfb83 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:18.073702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3282ed-43fc-480b-b546-0599070dfb83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:18.074002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3282ed-43fc-480b-b546-0599070dfb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:18.075431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3282ed-43fc-480b-b546-0599070dfb83 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:18.083824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 566/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:36:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:18.089681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5c9a0-4fe2-4b77-8563-a66fa68efb60 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:18.187663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5c9a0-4fe2-4b77-8563-a66fa68efb60 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:18.219909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac81b8-6174-40a7-a6db-eaa2af96dbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:18.220527 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac81b8-6174-40a7-a6db-eaa2af96dbb8 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:18.220801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac81b8-6174-40a7-a6db-eaa2af96dbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:18.221690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac81b8-6174-40a7-a6db-eaa2af96dbb8 None admin] PATH_INFO: `/v3/users/ea186f897bdd4196a21316b7daf5e2d2` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:18.222878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac81b8-6174-40a7-a6db-eaa2af96dbb8 None admin] RBAC: Authorizing `identity:get_user(user_id=ea186f897bdd4196a21316b7daf5e2d2)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:18.224295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac81b8-6174-40a7-a6db-eaa2af96dbb8 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:18.225859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 592/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:18 2022] GET /identity/v3/users/ea186f897bdd4196a21316b7daf5e2d2 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:18.232001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3282ed-43fc-480b-b546-0599070dfb83 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:18.324133 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:18.331220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3282ed-43fc-480b-b546-0599070dfb83 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:18.363860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51de334-300f-424a-8d2a-5cf7963c5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:18.364459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51de334-300f-424a-8d2a-5cf7963c5a15 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:18.364738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51de334-300f-424a-8d2a-5cf7963c5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:18.365008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51de334-300f-424a-8d2a-5cf7963c5a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:18.430421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51de334-300f-424a-8d2a-5cf7963c5a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:18.431903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51de334-300f-424a-8d2a-5cf7963c5a15 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:18.521061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:18.527762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 567/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:36:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:36:18.534274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac81b8-6174-40a7-a6db-eaa2af96dbb8 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:18.596946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:18.636913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac81b8-6174-40a7-a6db-eaa2af96dbb8 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:18.669701 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71336d-3919-486b-b4a3-84a69e280de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:18.670330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71336d-3919-486b-b4a3-84a69e280de9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:18.670611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71336d-3919-486b-b4a3-84a69e280de9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:18.670917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71336d-3919-486b-b4a3-84a69e280de9 None admin] PATH_INFO: `/v3/projects/97244195d0fb4db0a25fc7f1b7b72caf` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:18.672021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71336d-3919-486b-b4a3-84a69e280de9 None admin] RBAC: Authorizing `identity:get_project(project_id=97244195d0fb4db0a25fc7f1b7b72caf)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:18.673447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71336d-3919-486b-b4a3-84a69e280de9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:18.675806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 593/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:18 2022] GET /identity/v3/projects/97244195d0fb4db0a25fc7f1b7b72caf => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:18.681906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51de334-300f-424a-8d2a-5cf7963c5a15 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:18.778111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51de334-300f-424a-8d2a-5cf7963c5a15 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:18.814510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c147f5-cf97-460e-8725-09f1a84a725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:18.815167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c147f5-cf97-460e-8725-09f1a84a725d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:18.815447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c147f5-cf97-460e-8725-09f1a84a725d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:18.815717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c147f5-cf97-460e-8725-09f1a84a725d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:18.816430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c147f5-cf97-460e-8725-09f1a84a725d None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=97244195d0fb4db0a25fc7f1b7b72caf, user.id=ea186f897bdd4196a21316b7daf5e2d2) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:18.816734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c147f5-cf97-460e-8725-09f1a84a725d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:18.818150 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c147f5-cf97-460e-8725-09f1a84a725d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:18.824408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 568/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:36:18 2022] GET /identity/v3/role_assignments?user.id=ea186f897bdd4196a21316b7daf5e2d2&scope.project.id=97244195d0fb4db0a25fc7f1b7b72caf&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:20.810647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04a49-f967-4382-87db-d100235a978c None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:20.811246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04a49-f967-4382-87db-d100235a978c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:20.811246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04a49-f967-4382-87db-d100235a978c None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:20.812560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 594/1162] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:20.818210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45dac-b48b-46ac-b10f-f83bb303f61f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:20.818632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45dac-b48b-46ac-b10f-f83bb303f61f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:20.818786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45dac-b48b-46ac-b10f-f83bb303f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:20.836901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-32f45dac-b48b-46ac-b10f-f83bb303f61f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:20.838082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-32f45dac-b48b-46ac-b10f-f83bb303f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:20.893033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:20.903913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 569/1163] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:21.193697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e04a49-f967-4382-87db-d100235a978c None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:21.302990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e04a49-f967-4382-87db-d100235a978c None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:21.336510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:21.342458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e865a-a469-4f78-b66c-007fa21b13e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:21.343094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e865a-a469-4f78-b66c-007fa21b13e2 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:21.343372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e865a-a469-4f78-b66c-007fa21b13e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:21.343635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e865a-a469-4f78-b66c-007fa21b13e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:21.410899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e865a-a469-4f78-b66c-007fa21b13e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:21.412330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e865a-a469-4f78-b66c-007fa21b13e2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:21.507429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 595/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:36:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:36:21.513583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f45dac-b48b-46ac-b10f-f83bb303f61f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:21.622400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f45dac-b48b-46ac-b10f-f83bb303f61f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:21.658126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a96d-f038-47bd-a239-44120d89e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:21.659080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a96d-f038-47bd-a239-44120d89e368 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:21.659444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a96d-f038-47bd-a239-44120d89e368 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:21.659724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a96d-f038-47bd-a239-44120d89e368 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:21.666496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a96d-f038-47bd-a239-44120d89e368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:21.667978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a96d-f038-47bd-a239-44120d89e368 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-3f90a96d-f038-47bd-a239-44120d89e368 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:21.679968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:21.681149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:36:21.682527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 570/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:36:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:21.687155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e865a-a469-4f78-b66c-007fa21b13e2 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:21.716554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:21.785024 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e865a-a469-4f78-b66c-007fa21b13e2 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:21.818005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828fc17-156f-46a0-ae7d-5f1fdfe331f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:21.818613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828fc17-156f-46a0-ae7d-5f1fdfe331f5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:21.818897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828fc17-156f-46a0-ae7d-5f1fdfe331f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:21.819169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828fc17-156f-46a0-ae7d-5f1fdfe331f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:21.819803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828fc17-156f-46a0-ae7d-5f1fdfe331f5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:21.820104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828fc17-156f-46a0-ae7d-5f1fdfe331f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:21.821450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828fc17-156f-46a0-ae7d-5f1fdfe331f5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:21.828371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 596/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Aug 18 20:36:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:23.736678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdd96d-4916-431f-aaca-4c279d6990f2 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:23.737258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdd96d-4916-431f-aaca-4c279d6990f2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:23.737258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdd96d-4916-431f-aaca-4c279d6990f2 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:23.738546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 571/1167] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:23.743709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa27fe-80d8-4df4-8073-e75d90c282fc None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:23.744120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa27fe-80d8-4df4-8073-e75d90c282fc None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:23.744261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa27fe-80d8-4df4-8073-e75d90c282fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:23.762593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-73fa27fe-80d8-4df4-8073-e75d90c282fc None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:23.763819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-73fa27fe-80d8-4df4-8073-e75d90c282fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:23.831587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 597/1168] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:24.108297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdd96d-4916-431f-aaca-4c279d6990f2 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:24.160623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:24.211778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdd96d-4916-431f-aaca-4c279d6990f2 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:24.244088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b980f-e6c4-45bf-8efa-5f9786b5746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:24.244692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b980f-e6c4-45bf-8efa-5f9786b5746c None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:24.244968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b980f-e6c4-45bf-8efa-5f9786b5746c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:24.245241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b980f-e6c4-45bf-8efa-5f9786b5746c None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:24.245885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b980f-e6c4-45bf-8efa-5f9786b5746c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:24.247294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b980f-e6c4-45bf-8efa-5f9786b5746c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:24.263385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 572/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Thu Aug 18 20:36:24 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:36:26.292664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a522-a963-4add-a038-d08d74ce84ed None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:26.293235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a522-a963-4add-a038-d08d74ce84ed None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:26.293235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a522-a963-4add-a038-d08d74ce84ed None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:26.294539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 598/1170] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:26.300146 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c05b4-5928-4191-949f-d06236529ac3 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:26.300549 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c05b4-5928-4191-949f-d06236529ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:26.300712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c05b4-5928-4191-949f-d06236529ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:26.319192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-580c05b4-5928-4191-949f-d06236529ac3 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:26.320404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-580c05b4-5928-4191-949f-d06236529ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:26.389903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 573/1171] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:26.660897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098a522-a963-4add-a038-d08d74ce84ed None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:26.687845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:26.765401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098a522-a963-4add-a038-d08d74ce84ed None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:26.799422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295395f9-c787-43e0-8c8f-64b7a9c6df06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:26.800069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295395f9-c787-43e0-8c8f-64b7a9c6df06 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:26.800351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295395f9-c787-43e0-8c8f-64b7a9c6df06 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:26.800624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295395f9-c787-43e0-8c8f-64b7a9c6df06 None admin] PATH_INFO: `/v3/domains/3c5160846afb41648a3ec7b2286d9a84` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:26.810831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295395f9-c787-43e0-8c8f-64b7a9c6df06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c5160846afb41648a3ec7b2286d9a84)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:26.812268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295395f9-c787-43e0-8c8f-64b7a9c6df06 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:26.813861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 599/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Thu Aug 18 20:36:26 2022] GET /identity/v3/domains/3c5160846afb41648a3ec7b2286d9a84 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:26.820513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c05b4-5928-4191-949f-d06236529ac3 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:26.860597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:26.919129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c05b4-5928-4191-949f-d06236529ac3 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:26.952518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877014d-28c5-4c9d-bf93-4f3620985a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:26.953121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877014d-28c5-4c9d-bf93-4f3620985a46 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:26.953399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877014d-28c5-4c9d-bf93-4f3620985a46 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:26.953669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877014d-28c5-4c9d-bf93-4f3620985a46 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:26.954319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877014d-28c5-4c9d-bf93-4f3620985a46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:26.955818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877014d-28c5-4c9d-bf93-4f3620985a46 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:26.981752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 574/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:36:26 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:36:28.948440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4de67-79ba-4442-9715-17ad3e0e1973 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:28.948957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4de67-79ba-4442-9715-17ad3e0e1973 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:28.948957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4de67-79ba-4442-9715-17ad3e0e1973 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:28.950331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 600/1174] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:28.955573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae0c61-6f77-44f1-beb8-6c449a59ca4f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:28.956002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae0c61-6f77-44f1-beb8-6c449a59ca4f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:28.956122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae0c61-6f77-44f1-beb8-6c449a59ca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:28.974571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-98ae0c61-6f77-44f1-beb8-6c449a59ca4f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:28.975772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-98ae0c61-6f77-44f1-beb8-6c449a59ca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:29.040049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 575/1175] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:29.311406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4de67-79ba-4442-9715-17ad3e0e1973 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:29.396057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:29.413390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4de67-79ba-4442-9715-17ad3e0e1973 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:29.447131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8943d9-268a-4d3f-9c04-c56ad8430f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:29.447783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8943d9-268a-4d3f-9c04-c56ad8430f12 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:29.448064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8943d9-268a-4d3f-9c04-c56ad8430f12 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:29.448345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8943d9-268a-4d3f-9c04-c56ad8430f12 None admin] PATH_INFO: `/v3/domains/3c5160846afb41648a3ec7b2286d9a84` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:29.449446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8943d9-268a-4d3f-9c04-c56ad8430f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c5160846afb41648a3ec7b2286d9a84)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:29.450908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8943d9-268a-4d3f-9c04-c56ad8430f12 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:29.452477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 601/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Thu Aug 18 20:36:29 2022] GET /identity/v3/domains/3c5160846afb41648a3ec7b2286d9a84 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:29.458895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae0c61-6f77-44f1-beb8-6c449a59ca4f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:29.482788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:29.567225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae0c61-6f77-44f1-beb8-6c449a59ca4f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:29.602058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449836eb-39a4-495f-bf31-52610a43f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:29.602669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449836eb-39a4-495f-bf31-52610a43f467 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:29.602978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449836eb-39a4-495f-bf31-52610a43f467 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:29.603253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449836eb-39a4-495f-bf31-52610a43f467 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:29.603901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449836eb-39a4-495f-bf31-52610a43f467 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:29.605340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449836eb-39a4-495f-bf31-52610a43f467 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:29.627019 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 576/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:36:29 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:36:31.605540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84622f6-ef76-448d-a81b-0ed381755fb9 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:31.606058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84622f6-ef76-448d-a81b-0ed381755fb9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:31.606058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84622f6-ef76-448d-a81b-0ed381755fb9 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:31.607657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 602/1178] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:31.613766 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d31b-7ff2-4c33-9340-53db725312e6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:31.614296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d31b-7ff2-4c33-9340-53db725312e6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:31.614438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d31b-7ff2-4c33-9340-53db725312e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:31.633818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-69f1d31b-7ff2-4c33-9340-53db725312e6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:31.635050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-69f1d31b-7ff2-4c33-9340-53db725312e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:31.712377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 577/1179] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:32.004021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84622f6-ef76-448d-a81b-0ed381755fb9 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:32.109702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84622f6-ef76-448d-a81b-0ed381755fb9 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:32.144264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa29737-7493-490d-bbbc-bf1b697a59e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:32.144886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa29737-7493-490d-bbbc-bf1b697a59e7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:32.145167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa29737-7493-490d-bbbc-bf1b697a59e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:32.145439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa29737-7493-490d-bbbc-bf1b697a59e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:32.156135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa29737-7493-490d-bbbc-bf1b697a59e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-afa29737-7493-490d-bbbc-bf1b697a59e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:36:32.161333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:32.162543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:36:32.163698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 603/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:32.168656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d31b-7ff2-4c33-9340-53db725312e6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:32.179147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:32.269451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d31b-7ff2-4c33-9340-53db725312e6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:32.302553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3735821-2b68-449a-89e9-b4152a789d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:32.303188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3735821-2b68-449a-89e9-b4152a789d81 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:32.303464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3735821-2b68-449a-89e9-b4152a789d81 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:32.303734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3735821-2b68-449a-89e9-b4152a789d81 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:32.304389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3735821-2b68-449a-89e9-b4152a789d81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:32.304686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3735821-2b68-449a-89e9-b4152a789d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:32.306053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3735821-2b68-449a-89e9-b4152a789d81 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:32.314997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 578/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:36:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:32.321049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa29737-7493-490d-bbbc-bf1b697a59e7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:32.337279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:32.428947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa29737-7493-490d-bbbc-bf1b697a59e7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:32.462970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdc8c7-572d-407a-98e0-3a544a45be81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:32.463585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdc8c7-572d-407a-98e0-3a544a45be81 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:32.463774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdc8c7-572d-407a-98e0-3a544a45be81 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:32.464044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdc8c7-572d-407a-98e0-3a544a45be81 None admin] PATH_INFO: `/v3/users/6993a4324d4446518b0151f126f7e42e` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:32.478155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdc8c7-572d-407a-98e0-3a544a45be81 None admin] RBAC: Authorizing `identity:get_user(user_id=6993a4324d4446518b0151f126f7e42e)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:32.479615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdc8c7-572d-407a-98e0-3a544a45be81 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:32.481225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 604/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:32 2022] GET /identity/v3/users/6993a4324d4446518b0151f126f7e42e => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:32.487927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3735821-2b68-449a-89e9-b4152a789d81 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:32.556091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:32.591051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3735821-2b68-449a-89e9-b4152a789d81 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:32.627451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ca729-249b-4f26-9713-9a1e9b14e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:32.628397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca729-249b-4f26-9713-9a1e9b14e698 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:32.628864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca729-249b-4f26-9713-9a1e9b14e698 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:32.629313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca729-249b-4f26-9713-9a1e9b14e698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:32.698569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ca729-249b-4f26-9713-9a1e9b14e698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:32.700204 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ca729-249b-4f26-9713-9a1e9b14e698 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:32.770555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:32.804894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 579/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:36:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:36:32.810900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdc8c7-572d-407a-98e0-3a544a45be81 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:32.884040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:32.918022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdc8c7-572d-407a-98e0-3a544a45be81 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:32.952567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f563c-2fb1-4219-b507-d1c5e7125351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:32.953207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f563c-2fb1-4219-b507-d1c5e7125351 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:32.953474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f563c-2fb1-4219-b507-d1c5e7125351 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:32.953747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f563c-2fb1-4219-b507-d1c5e7125351 None admin] PATH_INFO: `/v3/projects/86cfb195eaa44f858169c54630aa7207` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:32.955400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f563c-2fb1-4219-b507-d1c5e7125351 None admin] RBAC: Authorizing `identity:get_project(project_id=86cfb195eaa44f858169c54630aa7207)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:32.957056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f563c-2fb1-4219-b507-d1c5e7125351 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:32.959123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 605/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:32 2022] GET /identity/v3/projects/86cfb195eaa44f858169c54630aa7207 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:32.966005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ca729-249b-4f26-9713-9a1e9b14e698 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:33.067511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ca729-249b-4f26-9713-9a1e9b14e698 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:33.100764 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ea3e9-5603-46bf-9bac-15f0c583209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:33.101359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ea3e9-5603-46bf-9bac-15f0c583209f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:33.101633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ea3e9-5603-46bf-9bac-15f0c583209f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:33.101901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ea3e9-5603-46bf-9bac-15f0c583209f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:33.102617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ea3e9-5603-46bf-9bac-15f0c583209f None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=86cfb195eaa44f858169c54630aa7207, user.id=6993a4324d4446518b0151f126f7e42e) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:33.102947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ea3e9-5603-46bf-9bac-15f0c583209f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:33.104374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ea3e9-5603-46bf-9bac-15f0c583209f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:33.109570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 580/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:36:32 2022] GET /identity/v3/role_assignments?user.id=6993a4324d4446518b0151f126f7e42e&scope.project.id=86cfb195eaa44f858169c54630aa7207&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:34.976299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a13de-5895-49da-ad99-1f7e627803a0 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:34.976843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a13de-5895-49da-ad99-1f7e627803a0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:34.976843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a13de-5895-49da-ad99-1f7e627803a0 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:34.978196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 606/1186] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:34.983426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f8d2-1e81-4682-a3a6-9dbc20a11a47 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:34.983817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f8d2-1e81-4682-a3a6-9dbc20a11a47 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:34.983973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f8d2-1e81-4682-a3a6-9dbc20a11a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:35.002707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2c99f8d2-1e81-4682-a3a6-9dbc20a11a47 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:35.003925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2c99f8d2-1e81-4682-a3a6-9dbc20a11a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:35.030234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:35.070205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 581/1187] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:35.347911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a13de-5895-49da-ad99-1f7e627803a0 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:35.450947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a13de-5895-49da-ad99-1f7e627803a0 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:35.486911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d1751-dadb-4a15-897c-e7b1dfd75037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:35.487562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1751-dadb-4a15-897c-e7b1dfd75037 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:35.487839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1751-dadb-4a15-897c-e7b1dfd75037 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:35.488110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1751-dadb-4a15-897c-e7b1dfd75037 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:35.495705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:35.499814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d1751-dadb-4a15-897c-e7b1dfd75037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-230d1751-dadb-4a15-897c-e7b1dfd75037 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:36:35.505457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:35.506599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:36:35.507963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 607/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:35.513027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99f8d2-1e81-4682-a3a6-9dbc20a11a47 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:35.612655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99f8d2-1e81-4682-a3a6-9dbc20a11a47 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:35.647129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892fc89-ef3e-4737-8662-f1307df62990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:35.647733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892fc89-ef3e-4737-8662-f1307df62990 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:35.648016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892fc89-ef3e-4737-8662-f1307df62990 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:35.648292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892fc89-ef3e-4737-8662-f1307df62990 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:35.648948 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892fc89-ef3e-4737-8662-f1307df62990 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:35.649252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892fc89-ef3e-4737-8662-f1307df62990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:35.650625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892fc89-ef3e-4737-8662-f1307df62990 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:35.659590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 582/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:36:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:35.666211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d1751-dadb-4a15-897c-e7b1dfd75037 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:35.770367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d1751-dadb-4a15-897c-e7b1dfd75037 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:35.804822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318d916-01cf-47fc-bd60-cfc3b4e7afba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:35.805446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318d916-01cf-47fc-bd60-cfc3b4e7afba None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:35.805725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318d916-01cf-47fc-bd60-cfc3b4e7afba None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:35.805995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318d916-01cf-47fc-bd60-cfc3b4e7afba None admin] PATH_INFO: `/v3/users/6993a4324d4446518b0151f126f7e42e` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:35.807133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318d916-01cf-47fc-bd60-cfc3b4e7afba None admin] RBAC: Authorizing `identity:get_user(user_id=6993a4324d4446518b0151f126f7e42e)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:35.808562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318d916-01cf-47fc-bd60-cfc3b4e7afba None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:35.810137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 608/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:35 2022] GET /identity/v3/users/6993a4324d4446518b0151f126f7e42e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:35.815979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892fc89-ef3e-4737-8662-f1307df62990 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:35.843535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:35.916682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892fc89-ef3e-4737-8662-f1307df62990 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:35.949291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405147-3857-4102-a35d-8be8b0f51883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:35.949914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405147-3857-4102-a35d-8be8b0f51883 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:35.950195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405147-3857-4102-a35d-8be8b0f51883 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:35.950470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405147-3857-4102-a35d-8be8b0f51883 None admin] PATH_INFO: `/v3/projects/86cfb195eaa44f858169c54630aa7207` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:35.951601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405147-3857-4102-a35d-8be8b0f51883 None admin] RBAC: Authorizing `identity:get_project(project_id=86cfb195eaa44f858169c54630aa7207)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:35.953051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405147-3857-4102-a35d-8be8b0f51883 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:35.955280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 583/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:35 2022] GET /identity/v3/projects/86cfb195eaa44f858169c54630aa7207 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:35.961307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318d916-01cf-47fc-bd60-cfc3b4e7afba None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:36.026611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:36.060601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318d916-01cf-47fc-bd60-cfc3b4e7afba None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:36.094549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ba59-eac8-4b1e-8123-eb7e1918f531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:36.095321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ba59-eac8-4b1e-8123-eb7e1918f531 None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:36.095596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ba59-eac8-4b1e-8123-eb7e1918f531 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:36.096038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ba59-eac8-4b1e-8123-eb7e1918f531 None admin] PATH_INFO: `/v3/projects/86cfb195eaa44f858169c54630aa7207/users/6993a4324d4446518b0151f126f7e42e/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:36.097995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3ba59-eac8-4b1e-8123-eb7e1918f531 None admin] RBAC: Authorizing `identity:create_grant(project_id=86cfb195eaa44f858169c54630aa7207, user_id=6993a4324d4446518b0151f126f7e42e, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:36.099447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3ba59-eac8-4b1e-8123-eb7e1918f531 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:36.111967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 609/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:36:35 2022] PUT /identity/v3/projects/86cfb195eaa44f858169c54630aa7207/users/6993a4324d4446518b0151f126f7e42e/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:36:38.026782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b9f0-abd4-4f85-8980-ec1ef8e5719c None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:38.027435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b9f0-abd4-4f85-8980-ec1ef8e5719c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:38.027435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b9f0-abd4-4f85-8980-ec1ef8e5719c None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:38.028703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 584/1193] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:38.033976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240e155-d45b-46ae-b892-7810382f8baf None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:38.034419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240e155-d45b-46ae-b892-7810382f8baf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:38.034513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240e155-d45b-46ae-b892-7810382f8baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:38.052471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5240e155-d45b-46ae-b892-7810382f8baf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:38.053848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5240e155-d45b-46ae-b892-7810382f8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:38.120080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 610/1194] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:38.391726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b9f0-abd4-4f85-8980-ec1ef8e5719c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:38.485432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:38.494134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b9f0-abd4-4f85-8980-ec1ef8e5719c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:38.528196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02dd63-54f4-4d2e-8a8e-b8a7201c4ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:38.528826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02dd63-54f4-4d2e-8a8e-b8a7201c4ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:38.529107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02dd63-54f4-4d2e-8a8e-b8a7201c4ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:38.529385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02dd63-54f4-4d2e-8a8e-b8a7201c4ec3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:38.539953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02dd63-54f4-4d2e-8a8e-b8a7201c4ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ec02dd63-54f4-4d2e-8a8e-b8a7201c4ec3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:36:38.544656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:38.545791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:36:38.546891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 585/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:36:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:38.552447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240e155-d45b-46ae-b892-7810382f8baf None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:38.608279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:38.651721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240e155-d45b-46ae-b892-7810382f8baf None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:38.684256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5da1-f270-4907-8db2-f0228543c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:38.684856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5da1-f270-4907-8db2-f0228543c7ea None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:38.685130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5da1-f270-4907-8db2-f0228543c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:38.685400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5da1-f270-4907-8db2-f0228543c7ea None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:38.686049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab5da1-f270-4907-8db2-f0228543c7ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:38.686346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab5da1-f270-4907-8db2-f0228543c7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:38.687724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab5da1-f270-4907-8db2-f0228543c7ea None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:38.695799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 611/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:38.701733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02dd63-54f4-4d2e-8a8e-b8a7201c4ec3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:38.803196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02dd63-54f4-4d2e-8a8e-b8a7201c4ec3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:38.837132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd878d7-3904-47da-be0e-611f41ab59f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:38.837842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd878d7-3904-47da-be0e-611f41ab59f9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:38.838126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd878d7-3904-47da-be0e-611f41ab59f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:38.838410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd878d7-3904-47da-be0e-611f41ab59f9 None admin] PATH_INFO: `/v3/users/6993a4324d4446518b0151f126f7e42e` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:38.839673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd878d7-3904-47da-be0e-611f41ab59f9 None admin] RBAC: Authorizing `identity:get_user(user_id=6993a4324d4446518b0151f126f7e42e)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:38.841120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd878d7-3904-47da-be0e-611f41ab59f9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:38.842702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 586/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:38 2022] GET /identity/v3/users/6993a4324d4446518b0151f126f7e42e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:38.849684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5da1-f270-4907-8db2-f0228543c7ea None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:38.955031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5da1-f270-4907-8db2-f0228543c7ea None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:38.971260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:38.987729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf667d1-18ca-4a86-af8f-cf0dba0686b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:38.988328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf667d1-18ca-4a86-af8f-cf0dba0686b7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:38.988602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf667d1-18ca-4a86-af8f-cf0dba0686b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:38.988865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf667d1-18ca-4a86-af8f-cf0dba0686b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:39.054052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf667d1-18ca-4a86-af8f-cf0dba0686b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:39.055513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf667d1-18ca-4a86-af8f-cf0dba0686b7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:39.150504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 612/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:36:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:36:39.156473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd878d7-3904-47da-be0e-611f41ab59f9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:39.181003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:39.256256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd878d7-3904-47da-be0e-611f41ab59f9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:39.290300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fadebf-2ef1-49af-a1ab-e9840326757e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:39.290971 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadebf-2ef1-49af-a1ab-e9840326757e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:39.291256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadebf-2ef1-49af-a1ab-e9840326757e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:39.291535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadebf-2ef1-49af-a1ab-e9840326757e None admin] PATH_INFO: `/v3/projects/86cfb195eaa44f858169c54630aa7207` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:39.292643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fadebf-2ef1-49af-a1ab-e9840326757e None admin] RBAC: Authorizing `identity:get_project(project_id=86cfb195eaa44f858169c54630aa7207)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:39.294084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fadebf-2ef1-49af-a1ab-e9840326757e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:39.295748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 587/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:39 2022] GET /identity/v3/projects/86cfb195eaa44f858169c54630aa7207 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:39.302164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf667d1-18ca-4a86-af8f-cf0dba0686b7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:39.320646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:39.400796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf667d1-18ca-4a86-af8f-cf0dba0686b7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:39.435442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c235f8c-7fb3-4218-ae8f-403da7f76d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:39.436038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235f8c-7fb3-4218-ae8f-403da7f76d90 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:39.436315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235f8c-7fb3-4218-ae8f-403da7f76d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:39.436586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235f8c-7fb3-4218-ae8f-403da7f76d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:39.437304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c235f8c-7fb3-4218-ae8f-403da7f76d90 None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=86cfb195eaa44f858169c54630aa7207, user.id=6993a4324d4446518b0151f126f7e42e) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:39.437612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c235f8c-7fb3-4218-ae8f-403da7f76d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:39.439658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c235f8c-7fb3-4218-ae8f-403da7f76d90 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:39.445323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 613/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:36:39 2022] GET /identity/v3/role_assignments?user.id=6993a4324d4446518b0151f126f7e42e&scope.project.id=86cfb195eaa44f858169c54630aa7207&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:49.286173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=55 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:49.442721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=59 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:36.172385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8999a-cf12-4164-aaa7-a860ff284fb3 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:36.172977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8999a-cf12-4164-aaa7-a860ff284fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:36.172977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8999a-cf12-4164-aaa7-a860ff284fb3 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:36.174269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 588/1201] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:36.182468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a6e0-568a-4c69-82fb-95deaad04bcf None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:36.183033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a6e0-568a-4c69-82fb-95deaad04bcf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:36.183231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a6e0-568a-4c69-82fb-95deaad04bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:36.208998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-71e3a6e0-568a-4c69-82fb-95deaad04bcf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:36.210242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-71e3a6e0-568a-4c69-82fb-95deaad04bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:36.309100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 614/1202] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:36.625932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8999a-cf12-4164-aaa7-a860ff284fb3 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:36.759244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8999a-cf12-4164-aaa7-a860ff284fb3 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:36.808550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da27b-8338-4582-978b-39185ae4f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:36.809563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da27b-8338-4582-978b-39185ae4f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:36.809847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da27b-8338-4582-978b-39185ae4f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:36.810121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da27b-8338-4582-978b-39185ae4f0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:36.825383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8da27b-8338-4582-978b-39185ae4f0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:36.827861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8da27b-8338-4582-978b-39185ae4f0a4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ff8da27b-8338-4582-978b-39185ae4f0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:36.850087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:36.851827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:36.852848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:36.852848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:36.852848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:36.855199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 589/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:36.857458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a6e0-568a-4c69-82fb-95deaad04bcf None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:36.999158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a6e0-568a-4c69-82fb-95deaad04bcf None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:37.041125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:37.049005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184fbdf-aefc-4ea7-a75a-88ec671b42de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:37.049811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184fbdf-aefc-4ea7-a75a-88ec671b42de None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:37.050321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184fbdf-aefc-4ea7-a75a-88ec671b42de None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:37.050517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184fbdf-aefc-4ea7-a75a-88ec671b42de None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:37.051210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184fbdf-aefc-4ea7-a75a-88ec671b42de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:37.051651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184fbdf-aefc-4ea7-a75a-88ec671b42de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:37.053737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184fbdf-aefc-4ea7-a75a-88ec671b42de None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:37.075748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 615/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:37.078545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da27b-8338-4582-978b-39185ae4f0a4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:37.156118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:37.220325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da27b-8338-4582-978b-39185ae4f0a4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:37.269161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8532f66-d87e-4e9b-8806-a771fa7e653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:37.269805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8532f66-d87e-4e9b-8806-a771fa7e653a None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:37.270116 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8532f66-d87e-4e9b-8806-a771fa7e653a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:37.270406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8532f66-d87e-4e9b-8806-a771fa7e653a None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:37.271487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8532f66-d87e-4e9b-8806-a771fa7e653a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:37.273604 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8532f66-d87e-4e9b-8806-a771fa7e653a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:37.312395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 590/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Aug 18 20:37:37 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:37:39.394528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55abb-8c9d-4424-963e-c1e427e86497 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:39.395167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55abb-8c9d-4424-963e-c1e427e86497 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:39.395167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55abb-8c9d-4424-963e-c1e427e86497 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:39.396758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 616/1206] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:39.402715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcb2b8-e529-43b6-b3b4-03d7629f88c1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:39.402715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcb2b8-e529-43b6-b3b4-03d7629f88c1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:39.403357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcb2b8-e529-43b6-b3b4-03d7629f88c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:39.424730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-64bcb2b8-e529-43b6-b3b4-03d7629f88c1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:39.425934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-64bcb2b8-e529-43b6-b3b4-03d7629f88c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:39.508367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 591/1207] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:39.774229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d55abb-8c9d-4424-963e-c1e427e86497 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:39.894873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d55abb-8c9d-4424-963e-c1e427e86497 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:39.947276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40440bb-5dc6-4ed9-ac69-0ea996c35498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:39.948060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40440bb-5dc6-4ed9-ac69-0ea996c35498 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:39.948366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40440bb-5dc6-4ed9-ac69-0ea996c35498 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:39.948682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40440bb-5dc6-4ed9-ac69-0ea996c35498 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:39.962616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40440bb-5dc6-4ed9-ac69-0ea996c35498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-a40440bb-5dc6-4ed9-ac69-0ea996c35498 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:39.967876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:39.969194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:39.970064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 617/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:37:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:39.975219 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcb2b8-e529-43b6-b3b4-03d7629f88c1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:40.022663 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:40.102454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcb2b8-e529-43b6-b3b4-03d7629f88c1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:40.147421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cf20-4a4c-4250-85fb-afe7017ced5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:40.148078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cf20-4a4c-4250-85fb-afe7017ced5e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:40.148344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cf20-4a4c-4250-85fb-afe7017ced5e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:40.148615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cf20-4a4c-4250-85fb-afe7017ced5e None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:40.149291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2cf20-4a4c-4250-85fb-afe7017ced5e None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:40.149583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2cf20-4a4c-4250-85fb-afe7017ced5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:40.151065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2cf20-4a4c-4250-85fb-afe7017ced5e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:40.160101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 592/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:37:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:40.166540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40440bb-5dc6-4ed9-ac69-0ea996c35498 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:40.230814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:40.300363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40440bb-5dc6-4ed9-ac69-0ea996c35498 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:40.340449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9245f89-bdb0-433f-97bb-2969c547a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:40.341104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9245f89-bdb0-433f-97bb-2969c547a843 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:40.341382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9245f89-bdb0-433f-97bb-2969c547a843 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:40.341651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9245f89-bdb0-433f-97bb-2969c547a843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:40.353937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9245f89-bdb0-433f-97bb-2969c547a843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:40.355378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9245f89-bdb0-433f-97bb-2969c547a843 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-d9245f89-bdb0-433f-97bb-2969c547a843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:40.371423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:40.373177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:40.374685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:40.374685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:40.374685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:40.374685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 618/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:40.383394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cf20-4a4c-4250-85fb-afe7017ced5e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:40.512847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cf20-4a4c-4250-85fb-afe7017ced5e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:40.515619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:40.552516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513d964-eaeb-482d-9146-b27996a60531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:40.553426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513d964-eaeb-482d-9146-b27996a60531 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:40.553899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513d964-eaeb-482d-9146-b27996a60531 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:40.554228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513d964-eaeb-482d-9146-b27996a60531 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:40.554961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513d964-eaeb-482d-9146-b27996a60531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:40.555264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513d964-eaeb-482d-9146-b27996a60531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:40.556653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513d964-eaeb-482d-9146-b27996a60531 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:40.569990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 593/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:40.575802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9245f89-bdb0-433f-97bb-2969c547a843 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:40.699567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9245f89-bdb0-433f-97bb-2969c547a843 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:40.701155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:40.740600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02834f5-33d6-4817-ad72-77bf1cef7dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:40.741273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02834f5-33d6-4817-ad72-77bf1cef7dda None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:40.741588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02834f5-33d6-4817-ad72-77bf1cef7dda None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:40.741888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02834f5-33d6-4817-ad72-77bf1cef7dda None admin] PATH_INFO: `/v3/users/placement` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:40.750855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02834f5-33d6-4817-ad72-77bf1cef7dda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:40.752298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02834f5-33d6-4817-ad72-77bf1cef7dda None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-f02834f5-33d6-4817-ad72-77bf1cef7dda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:40.764005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:40.765408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:40.766399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 619/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:37:40.771622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513d964-eaeb-482d-9146-b27996a60531 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:40.885258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513d964-eaeb-482d-9146-b27996a60531 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:40.924864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241788b-fa06-47e5-9f93-da29170098b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:40.925466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241788b-fa06-47e5-9f93-da29170098b9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:40.928178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241788b-fa06-47e5-9f93-da29170098b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:40.928178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241788b-fa06-47e5-9f93-da29170098b9 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:40.928178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241788b-fa06-47e5-9f93-da29170098b9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:40.928178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241788b-fa06-47e5-9f93-da29170098b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:40.928455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241788b-fa06-47e5-9f93-da29170098b9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:40.954119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 594/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:40.955440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02834f5-33d6-4817-ad72-77bf1cef7dda None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.081792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02834f5-33d6-4817-ad72-77bf1cef7dda None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.125266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93a15e-adee-48f7-a654-f564187a9ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.126151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93a15e-adee-48f7-a654-f564187a9ce7 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.126433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93a15e-adee-48f7-a654-f564187a9ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.126709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93a15e-adee-48f7-a654-f564187a9ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.168939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:41.220252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93a15e-adee-48f7-a654-f564187a9ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.221759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93a15e-adee-48f7-a654-f564187a9ce7 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:41.348861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 620/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:37:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:37:41.355153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241788b-fa06-47e5-9f93-da29170098b9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.377377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:41.495577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241788b-fa06-47e5-9f93-da29170098b9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.534634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d02ed0-5fd4-481b-a56e-d389e66f15c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.535388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d02ed0-5fd4-481b-a56e-d389e66f15c5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.535649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d02ed0-5fd4-481b-a56e-d389e66f15c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.535965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d02ed0-5fd4-481b-a56e-d389e66f15c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.549925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d02ed0-5fd4-481b-a56e-d389e66f15c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.551657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d02ed0-5fd4-481b-a56e-d389e66f15c5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-19d02ed0-5fd4-481b-a56e-d389e66f15c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:41.570794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:41.577518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:41.578639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:41.578639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:41.578639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:41.578639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 595/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:41.578923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93a15e-adee-48f7-a654-f564187a9ce7 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.649965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:41.690812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93a15e-adee-48f7-a654-f564187a9ce7 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.728328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeda6c0-dc7f-41bc-8a16-85975efc2536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.728976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeda6c0-dc7f-41bc-8a16-85975efc2536 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.729203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeda6c0-dc7f-41bc-8a16-85975efc2536 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.729529 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeda6c0-dc7f-41bc-8a16-85975efc2536 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.730224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeda6c0-dc7f-41bc-8a16-85975efc2536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:41.730526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeda6c0-dc7f-41bc-8a16-85975efc2536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.732005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeda6c0-dc7f-41bc-8a16-85975efc2536 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:41.744530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 621/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:41.751379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d02ed0-5fd4-481b-a56e-d389e66f15c5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.835371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:41.873992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d02ed0-5fd4-481b-a56e-d389e66f15c5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.908374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a4e9e-662b-4a91-99fb-5f355ca1aec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.909104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a4e9e-662b-4a91-99fb-5f355ca1aec7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.909390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a4e9e-662b-4a91-99fb-5f355ca1aec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.909662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a4e9e-662b-4a91-99fb-5f355ca1aec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.918182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a4e9e-662b-4a91-99fb-5f355ca1aec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.919692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a4e9e-662b-4a91-99fb-5f355ca1aec7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-760a4e9e-662b-4a91-99fb-5f355ca1aec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:41.932515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:41.933541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:41.940106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:41.940106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:41.940106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:41.940106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:41.940106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:41.940106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:41.940106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:41.940106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:41.940106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 596/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:41.940631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeda6c0-dc7f-41bc-8a16-85975efc2536 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:42.064022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeda6c0-dc7f-41bc-8a16-85975efc2536 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:42.091515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:42.106940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23aa30-a252-46fa-a2eb-8a93671e98d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:42.111466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23aa30-a252-46fa-a2eb-8a93671e98d1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:42.111775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23aa30-a252-46fa-a2eb-8a93671e98d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:42.112057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23aa30-a252-46fa-a2eb-8a93671e98d1 None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:42.112798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23aa30-a252-46fa-a2eb-8a93671e98d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:42.113114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23aa30-a252-46fa-a2eb-8a93671e98d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:42.114560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23aa30-a252-46fa-a2eb-8a93671e98d1 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:42.130460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 622/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:42.137195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a4e9e-662b-4a91-99fb-5f355ca1aec7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:42.259437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a4e9e-662b-4a91-99fb-5f355ca1aec7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:42.290641 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:42.297875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92d00a-4b68-47ca-b64c-ba685d9d37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:42.298485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92d00a-4b68-47ca-b64c-ba685d9d37ac None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:42.298835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92d00a-4b68-47ca-b64c-ba685d9d37ac None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:42.299060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92d00a-4b68-47ca-b64c-ba685d9d37ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:42.299785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92d00a-4b68-47ca-b64c-ba685d9d37ac None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=be696635db224e3a868957eb5b5bae0e) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:42.300090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92d00a-4b68-47ca-b64c-ba685d9d37ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:42.301522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92d00a-4b68-47ca-b64c-ba685d9d37ac None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:42.318895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 597/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:37:42 2022] GET /identity/v3/role_assignments?user.id=be696635db224e3a868957eb5b5bae0e&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:44.220930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a442947-20b9-4df7-82d2-0b1046cfd961 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:44.221635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a442947-20b9-4df7-82d2-0b1046cfd961 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:44.221635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a442947-20b9-4df7-82d2-0b1046cfd961 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:44.222886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 623/1220] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:37:44.231400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e696913-2700-4ee2-99fe-815744753783 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:44.232027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e696913-2700-4ee2-99fe-815744753783 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:44.232027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e696913-2700-4ee2-99fe-815744753783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:44.255695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8e696913-2700-4ee2-99fe-815744753783 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:44.257189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8e696913-2700-4ee2-99fe-815744753783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:44.342189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 598/1221] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:37:44.637447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a442947-20b9-4df7-82d2-0b1046cfd961 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:44.756130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a442947-20b9-4df7-82d2-0b1046cfd961 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:44.796746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e23e46-1914-40ef-8048-7778f479aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:44.797359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e23e46-1914-40ef-8048-7778f479aa89 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:44.797637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e23e46-1914-40ef-8048-7778f479aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:44.797902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e23e46-1914-40ef-8048-7778f479aa89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:44.808978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e23e46-1914-40ef-8048-7778f479aa89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-a9e23e46-1914-40ef-8048-7778f479aa89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:44.813926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:44.818902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:44.819990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 624/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:37:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:44.821146 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e696913-2700-4ee2-99fe-815744753783 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:44.926500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e696913-2700-4ee2-99fe-815744753783 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:44.952226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:44.964964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c477-4b69-4157-ae5f-56efe8424c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:44.965575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c477-4b69-4157-ae5f-56efe8424c72 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:44.965851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c477-4b69-4157-ae5f-56efe8424c72 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:44.966172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c477-4b69-4157-ae5f-56efe8424c72 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:44.967026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6c477-4b69-4157-ae5f-56efe8424c72 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:44.967395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6c477-4b69-4157-ae5f-56efe8424c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:44.968969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6c477-4b69-4157-ae5f-56efe8424c72 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:44.977539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 599/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:37:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:44.983651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e23e46-1914-40ef-8048-7778f479aa89 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.028466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:45.090280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e23e46-1914-40ef-8048-7778f479aa89 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.134829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aa12c-b6e7-4bfc-99ee-046157df259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.135491 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aa12c-b6e7-4bfc-99ee-046157df259e None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.135780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aa12c-b6e7-4bfc-99ee-046157df259e None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.136117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aa12c-b6e7-4bfc-99ee-046157df259e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.147246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917aa12c-b6e7-4bfc-99ee-046157df259e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.148741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917aa12c-b6e7-4bfc-99ee-046157df259e None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-917aa12c-b6e7-4bfc-99ee-046157df259e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:45.164053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:45.165298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:45.166430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:45.166430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:45.166430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:45.166430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 625/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:45.172379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c477-4b69-4157-ae5f-56efe8424c72 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.288457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c477-4b69-4157-ae5f-56efe8424c72 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.323460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416928-0564-4593-8fe8-a037e7680ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.324083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416928-0564-4593-8fe8-a037e7680ec8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.324413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416928-0564-4593-8fe8-a037e7680ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.324628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416928-0564-4593-8fe8-a037e7680ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.325345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416928-0564-4593-8fe8-a037e7680ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:45.325567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416928-0564-4593-8fe8-a037e7680ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.327635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416928-0564-4593-8fe8-a037e7680ec8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.339919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 600/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:45.345917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aa12c-b6e7-4bfc-99ee-046157df259e None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.444217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:45.452276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aa12c-b6e7-4bfc-99ee-046157df259e None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.490261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4522-afb0-4850-bf9b-fedfdbcf7b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.491043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4522-afb0-4850-bf9b-fedfdbcf7b9a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.491379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4522-afb0-4850-bf9b-fedfdbcf7b9a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.491684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4522-afb0-4850-bf9b-fedfdbcf7b9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.500404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b4522-afb0-4850-bf9b-fedfdbcf7b9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.502004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b4522-afb0-4850-bf9b-fedfdbcf7b9a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-7f7b4522-afb0-4850-bf9b-fedfdbcf7b9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:45.515300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:45.516479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:45.517448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 626/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:37:45.522512 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416928-0564-4593-8fe8-a037e7680ec8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.581506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:45.647867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416928-0564-4593-8fe8-a037e7680ec8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.689412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf17ea9-cf2a-45b3-abd6-e7cbab80b6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.690099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf17ea9-cf2a-45b3-abd6-e7cbab80b6c4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.690423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf17ea9-cf2a-45b3-abd6-e7cbab80b6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.690738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf17ea9-cf2a-45b3-abd6-e7cbab80b6c4 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.691643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf17ea9-cf2a-45b3-abd6-e7cbab80b6c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:45.692029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf17ea9-cf2a-45b3-abd6-e7cbab80b6c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.693593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf17ea9-cf2a-45b3-abd6-e7cbab80b6c4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.711861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 601/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:45.718488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4522-afb0-4850-bf9b-fedfdbcf7b9a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.837207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4522-afb0-4850-bf9b-fedfdbcf7b9a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.883925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e81a-3dd3-4ea9-b92e-ba9a7a1c0fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.884678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e81a-3dd3-4ea9-b92e-ba9a7a1c0fec None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.885023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e81a-3dd3-4ea9-b92e-ba9a7a1c0fec None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.885391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e81a-3dd3-4ea9-b92e-ba9a7a1c0fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.898211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5e81a-3dd3-4ea9-b92e-ba9a7a1c0fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.899858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5e81a-3dd3-4ea9-b92e-ba9a7a1c0fec None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-41b5e81a-3dd3-4ea9-b92e-ba9a7a1c0fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:45.916445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:45.917575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:45.918492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:45.918492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:45.918492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:45.918492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 627/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:45.925349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf17ea9-cf2a-45b3-abd6-e7cbab80b6c4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:46.042638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf17ea9-cf2a-45b3-abd6-e7cbab80b6c4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:46.045291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:46.086423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9048eb-aea4-4e21-b31d-722bdfb0e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:46.087171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9048eb-aea4-4e21-b31d-722bdfb0e97f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:46.087566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9048eb-aea4-4e21-b31d-722bdfb0e97f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:46.087935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9048eb-aea4-4e21-b31d-722bdfb0e97f None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.088616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9048eb-aea4-4e21-b31d-722bdfb0e97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:46.089002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9048eb-aea4-4e21-b31d-722bdfb0e97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.090560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9048eb-aea4-4e21-b31d-722bdfb0e97f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.108300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 602/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:46.114704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e81a-3dd3-4ea9-b92e-ba9a7a1c0fec None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:46.128385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:46.250930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e81a-3dd3-4ea9-b92e-ba9a7a1c0fec None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:46.295672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80439fb3-6c89-4215-b6d0-b4901b41eecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:46.296625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80439fb3-6c89-4215-b6d0-b4901b41eecb None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:46.296916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80439fb3-6c89-4215-b6d0-b4901b41eecb None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:46.297190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80439fb3-6c89-4215-b6d0-b4901b41eecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.308950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80439fb3-6c89-4215-b6d0-b4901b41eecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.311000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80439fb3-6c89-4215-b6d0-b4901b41eecb None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-80439fb3-6c89-4215-b6d0-b4901b41eecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:46.326869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:46.328198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:46.329212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:46.329212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:46.329212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:46.329212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:46.329212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:46.329212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:46.329212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:46.329212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:46.329212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 628/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:37:46.335078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9048eb-aea4-4e21-b31d-722bdfb0e97f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:46.451490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9048eb-aea4-4e21-b31d-722bdfb0e97f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:46.498484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff26c3-5925-4999-ab1a-3d68404d666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:46.499425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff26c3-5925-4999-ab1a-3d68404d666b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:46.499779 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff26c3-5925-4999-ab1a-3d68404d666b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:46.500894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff26c3-5925-4999-ab1a-3d68404d666b None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.501879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff26c3-5925-4999-ab1a-3d68404d666b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:46.502258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff26c3-5925-4999-ab1a-3d68404d666b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.504298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff26c3-5925-4999-ab1a-3d68404d666b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.517871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 603/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:46.524002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80439fb3-6c89-4215-b6d0-b4901b41eecb None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:46.599368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:46.643198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80439fb3-6c89-4215-b6d0-b4901b41eecb None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:46.680315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25d3bb-19d7-4078-9d35-e6236b8c29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:46.681121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25d3bb-19d7-4078-9d35-e6236b8c29ce None admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:46.681407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25d3bb-19d7-4078-9d35-e6236b8c29ce None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:46.681684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25d3bb-19d7-4078-9d35-e6236b8c29ce None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/be696635db224e3a868957eb5b5bae0e/roles/04d187050a844fdf95f14768fd866f8e` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.698235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25d3bb-19d7-4078-9d35-e6236b8c29ce None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=be696635db224e3a868957eb5b5bae0e, role_id=04d187050a844fdf95f14768fd866f8e)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.699695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25d3bb-19d7-4078-9d35-e6236b8c29ce None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.722302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 629/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:37:46 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/be696635db224e3a868957eb5b5bae0e/roles/04d187050a844fdf95f14768fd866f8e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:37:48.952985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de161c-c2ce-4ab0-ad57-b44f355ec36a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:48.953539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de161c-c2ce-4ab0-ad57-b44f355ec36a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:48.953539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de161c-c2ce-4ab0-ad57-b44f355ec36a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:48.954884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 604/1233] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:37:48.960208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0121-f6a8-49a6-af91-74e2e55a0873 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:48.960674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0121-f6a8-49a6-af91-74e2e55a0873 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:48.960797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0121-f6a8-49a6-af91-74e2e55a0873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:48.979665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-9f5f0121-f6a8-49a6-af91-74e2e55a0873 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:48.980881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9f5f0121-f6a8-49a6-af91-74e2e55a0873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:49.053273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 630/1234] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:49.333341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de161c-c2ce-4ab0-ad57-b44f355ec36a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:49.362712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:49.460972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de161c-c2ce-4ab0-ad57-b44f355ec36a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:49.508713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd6739-bd84-46e2-8e1c-874d022cd4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:49.509569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd6739-bd84-46e2-8e1c-874d022cd4df None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:49.509847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd6739-bd84-46e2-8e1c-874d022cd4df None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:49.510257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd6739-bd84-46e2-8e1c-874d022cd4df None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:49.525024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd6739-bd84-46e2-8e1c-874d022cd4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2cbd6739-bd84-46e2-8e1c-874d022cd4df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:49.531253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:49.534944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:49.536188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 605/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Aug 18 20:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:49.539392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0121-f6a8-49a6-af91-74e2e55a0873 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:49.595173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:49.658941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0121-f6a8-49a6-af91-74e2e55a0873 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:49.705503 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf3b8d-cbb9-4190-97d4-a03026db19a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:49.706130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3b8d-cbb9-4190-97d4-a03026db19a9 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:49.706411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3b8d-cbb9-4190-97d4-a03026db19a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:49.706687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3b8d-cbb9-4190-97d4-a03026db19a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:49.707395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf3b8d-cbb9-4190-97d4-a03026db19a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:49.707703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf3b8d-cbb9-4190-97d4-a03026db19a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:49.709085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf3b8d-cbb9-4190-97d4-a03026db19a9 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:49.717606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 631/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Aug 18 20:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:49.723804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd6739-bd84-46e2-8e1c-874d022cd4df None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:49.832803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:49.854672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd6739-bd84-46e2-8e1c-874d022cd4df None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:49.914289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b74e-e9e6-4282-a7d6-8f141194fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:49.914966 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b74e-e9e6-4282-a7d6-8f141194fc1f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:49.915245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b74e-e9e6-4282-a7d6-8f141194fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:49.915515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b74e-e9e6-4282-a7d6-8f141194fc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:49.928485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909b74e-e9e6-4282-a7d6-8f141194fc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:49.929962 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909b74e-e9e6-4282-a7d6-8f141194fc1f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1909b74e-e9e6-4282-a7d6-8f141194fc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:49.948056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:49.949295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:49.950215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:49.950215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:49.950215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:49.950215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 606/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:37:49.956059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf3b8d-cbb9-4190-97d4-a03026db19a9 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:50.096152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf3b8d-cbb9-4190-97d4-a03026db19a9 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:50.110398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:50.149603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de793cd4-b16c-4440-9e3c-517535802711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:50.150794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de793cd4-b16c-4440-9e3c-517535802711 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:50.151381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de793cd4-b16c-4440-9e3c-517535802711 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:50.151893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de793cd4-b16c-4440-9e3c-517535802711 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:50.152879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de793cd4-b16c-4440-9e3c-517535802711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:50.153368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de793cd4-b16c-4440-9e3c-517535802711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:50.155813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de793cd4-b16c-4440-9e3c-517535802711 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:50.178907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 632/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:50.180207 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b74e-e9e6-4282-a7d6-8f141194fc1f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:50.314605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b74e-e9e6-4282-a7d6-8f141194fc1f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:50.353703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a430e61-870f-4204-8b3f-5b4011c8e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:50.354343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a430e61-870f-4204-8b3f-5b4011c8e0db None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:50.354621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a430e61-870f-4204-8b3f-5b4011c8e0db None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:50.354923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a430e61-870f-4204-8b3f-5b4011c8e0db None admin] PATH_INFO: `/v3/users/placement` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:50.360256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:50.365823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a430e61-870f-4204-8b3f-5b4011c8e0db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:50.367408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a430e61-870f-4204-8b3f-5b4011c8e0db None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1a430e61-870f-4204-8b3f-5b4011c8e0db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:50.382631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:50.383950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:50.384979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 607/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:50.391056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de793cd4-b16c-4440-9e3c-517535802711 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:50.506466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de793cd4-b16c-4440-9e3c-517535802711 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:50.554261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05a210-8f84-4262-9c44-0760a8ec8de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:50.554924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a210-8f84-4262-9c44-0760a8ec8de6 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:50.557822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a210-8f84-4262-9c44-0760a8ec8de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:50.557822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a210-8f84-4262-9c44-0760a8ec8de6 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:50.557822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05a210-8f84-4262-9c44-0760a8ec8de6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:50.557822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05a210-8f84-4262-9c44-0760a8ec8de6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:50.558381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05a210-8f84-4262-9c44-0760a8ec8de6 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:50.584603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 633/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:50.586222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a430e61-870f-4204-8b3f-5b4011c8e0db None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:50.697920 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a430e61-870f-4204-8b3f-5b4011c8e0db None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:50.740422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41167ba-4960-4d73-a570-cdda3a965257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:50.741073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41167ba-4960-4d73-a570-cdda3a965257 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:50.741348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41167ba-4960-4d73-a570-cdda3a965257 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:50.741615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41167ba-4960-4d73-a570-cdda3a965257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:50.817183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:50.825009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41167ba-4960-4d73-a570-cdda3a965257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:50.827221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41167ba-4960-4d73-a570-cdda3a965257 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:50.941471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 608/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:37:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:37:50.947759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05a210-8f84-4262-9c44-0760a8ec8de6 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:50.983052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:51.078187 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05a210-8f84-4262-9c44-0760a8ec8de6 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:51.129621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d46879-4043-4092-a1a1-01a5704fd5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:51.130583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d46879-4043-4092-a1a1-01a5704fd5a5 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:51.130877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d46879-4043-4092-a1a1-01a5704fd5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:51.131364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d46879-4043-4092-a1a1-01a5704fd5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:51.144466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d46879-4043-4092-a1a1-01a5704fd5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:51.145955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d46879-4043-4092-a1a1-01a5704fd5a5 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-57d46879-4043-4092-a1a1-01a5704fd5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:51.161901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:51.167801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:51.168969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:51.168969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:51.168969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:51.168969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 634/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:37:51.169261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41167ba-4960-4d73-a570-cdda3a965257 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:51.294744 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:51.302195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41167ba-4960-4d73-a570-cdda3a965257 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:51.342051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f56e01-aeee-48f0-9669-a866d214e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:51.342884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f56e01-aeee-48f0-9669-a866d214e0c3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:51.343172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f56e01-aeee-48f0-9669-a866d214e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:51.343447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f56e01-aeee-48f0-9669-a866d214e0c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:51.344178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f56e01-aeee-48f0-9669-a866d214e0c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:51.344525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f56e01-aeee-48f0-9669-a866d214e0c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:51.346377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f56e01-aeee-48f0-9669-a866d214e0c3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:51.365117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 609/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:37:51.372485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d46879-4043-4092-a1a1-01a5704fd5a5 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:51.468190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:51.489623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d46879-4043-4092-a1a1-01a5704fd5a5 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:51.524861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca012bea-523d-4351-ae45-395b9b43fe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:51.525491 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca012bea-523d-4351-ae45-395b9b43fe3b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:51.525774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca012bea-523d-4351-ae45-395b9b43fe3b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:51.526041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca012bea-523d-4351-ae45-395b9b43fe3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:51.534256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca012bea-523d-4351-ae45-395b9b43fe3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:51.536083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca012bea-523d-4351-ae45-395b9b43fe3b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-ca012bea-523d-4351-ae45-395b9b43fe3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:51.549059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:51.550045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:51.551034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:51.551034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:51.551034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:51.551034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:51.551034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:51.551034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:51.551034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:51.551034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:51.551034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 635/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:51.556809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f56e01-aeee-48f0-9669-a866d214e0c3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:51.681446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f56e01-aeee-48f0-9669-a866d214e0c3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:51.717267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5796b6-6772-4cf8-a10f-c4523ab2e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:51.717969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5796b6-6772-4cf8-a10f-c4523ab2e6ea None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:51.718250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5796b6-6772-4cf8-a10f-c4523ab2e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:51.718518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5796b6-6772-4cf8-a10f-c4523ab2e6ea None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:51.719239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5796b6-6772-4cf8-a10f-c4523ab2e6ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:51.719539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5796b6-6772-4cf8-a10f-c4523ab2e6ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:51.720978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5796b6-6772-4cf8-a10f-c4523ab2e6ea None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:51.739447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 610/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:51.745881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca012bea-523d-4351-ae45-395b9b43fe3b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:51.878838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca012bea-523d-4351-ae45-395b9b43fe3b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:51.923979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965cf43-642a-435a-a32b-b0827a62e603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:51.924598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965cf43-642a-435a-a32b-b0827a62e603 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:51.924867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965cf43-642a-435a-a32b-b0827a62e603 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:51.925128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965cf43-642a-435a-a32b-b0827a62e603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:51.925853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965cf43-642a-435a-a32b-b0827a62e603 None admin] RBAC: Adding query filter params (role.id=04d187050a844fdf95f14768fd866f8e, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=be696635db224e3a868957eb5b5bae0e) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:51.926156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965cf43-642a-435a-a32b-b0827a62e603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:51.927607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965cf43-642a-435a-a32b-b0827a62e603 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:51.934139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 636/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:37:51 2022] GET /identity/v3/role_assignments?user.id=be696635db224e3a868957eb5b5bae0e&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=04d187050a844fdf95f14768fd866f8e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:54.288238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718913-55d4-4310-b469-431a031d70ed None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:54.288961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718913-55d4-4310-b469-431a031d70ed None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:54.288961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718913-55d4-4310-b469-431a031d70ed None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:54.290292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 611/1247] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:54.296627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a7d3-2650-467b-b74e-1e10e9240dc8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:54.297066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a7d3-2650-467b-b74e-1e10e9240dc8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:54.297273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a7d3-2650-467b-b74e-1e10e9240dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:54.304702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:54.319924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0520a7d3-2650-467b-b74e-1e10e9240dc8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:54.321133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0520a7d3-2650-467b-b74e-1e10e9240dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:54.401176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 637/1248] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:54.717604 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec718913-55d4-4310-b469-431a031d70ed None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:54.741394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:54.841943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec718913-55d4-4310-b469-431a031d70ed None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:54.887993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299473c8-9bb5-4dcf-b7f0-e9b9a9f6ca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:54.888643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299473c8-9bb5-4dcf-b7f0-e9b9a9f6ca65 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:54.888997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299473c8-9bb5-4dcf-b7f0-e9b9a9f6ca65 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:54.889296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299473c8-9bb5-4dcf-b7f0-e9b9a9f6ca65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:54.903301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299473c8-9bb5-4dcf-b7f0-e9b9a9f6ca65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-299473c8-9bb5-4dcf-b7f0-e9b9a9f6ca65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:54.909102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:54.910416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:54.915679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 612/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:37:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:54.917231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520a7d3-2650-467b-b74e-1e10e9240dc8 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:55.040955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520a7d3-2650-467b-b74e-1e10e9240dc8 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:55.083375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:55.090941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e3d8b-894b-4ac2-ad0e-133b61e8ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:55.092519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e3d8b-894b-4ac2-ad0e-133b61e8ae37 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:55.092835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e3d8b-894b-4ac2-ad0e-133b61e8ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:55.093150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e3d8b-894b-4ac2-ad0e-133b61e8ae37 None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:55.094039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e3d8b-894b-4ac2-ad0e-133b61e8ae37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:55.094388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e3d8b-894b-4ac2-ad0e-133b61e8ae37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:55.096142 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e3d8b-894b-4ac2-ad0e-133b61e8ae37 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:55.108152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 638/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:37:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:55.114262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299473c8-9bb5-4dcf-b7f0-e9b9a9f6ca65 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:55.217771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:55.243415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299473c8-9bb5-4dcf-b7f0-e9b9a9f6ca65 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:55.283774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35979a7a-9c98-4103-92da-d0173d733917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:55.284554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35979a7a-9c98-4103-92da-d0173d733917 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:55.284877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35979a7a-9c98-4103-92da-d0173d733917 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:55.285278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35979a7a-9c98-4103-92da-d0173d733917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:55.297137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35979a7a-9c98-4103-92da-d0173d733917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:55.298858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35979a7a-9c98-4103-92da-d0173d733917 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-35979a7a-9c98-4103-92da-d0173d733917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:55.315691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:55.316777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:55.318051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:55.318051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:55.318051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:55.318051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 613/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:55.323306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e3d8b-894b-4ac2-ad0e-133b61e8ae37 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:55.431057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e3d8b-894b-4ac2-ad0e-133b61e8ae37 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:55.469938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb5698-980c-446d-afcc-cec3bf076f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:55.470467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb5698-980c-446d-afcc-cec3bf076f07 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:55.470744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb5698-980c-446d-afcc-cec3bf076f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:55.471059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb5698-980c-446d-afcc-cec3bf076f07 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:55.471826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb5698-980c-446d-afcc-cec3bf076f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:55.472159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb5698-980c-446d-afcc-cec3bf076f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:55.473557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb5698-980c-446d-afcc-cec3bf076f07 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:55.486849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 639/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:55.492498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35979a7a-9c98-4103-92da-d0173d733917 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:55.613134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35979a7a-9c98-4103-92da-d0173d733917 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:55.642697 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:55.652529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e8b1c-d11b-4b90-b735-945c24094ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:55.653220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e8b1c-d11b-4b90-b735-945c24094ca9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:55.653504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e8b1c-d11b-4b90-b735-945c24094ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:55.654264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e8b1c-d11b-4b90-b735-945c24094ca9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:55.662651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e8b1c-d11b-4b90-b735-945c24094ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:55.664149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e8b1c-d11b-4b90-b735-945c24094ca9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-659e8b1c-d11b-4b90-b735-945c24094ca9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:55.677247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:55.678409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:55.679505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 614/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:55.684475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb5698-980c-446d-afcc-cec3bf076f07 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:55.750487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:55.798730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb5698-980c-446d-afcc-cec3bf076f07 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:55.836493 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ff08-eca0-4617-b697-2570b69605cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:55.837088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ff08-eca0-4617-b697-2570b69605cf None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:55.837371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ff08-eca0-4617-b697-2570b69605cf None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:55.837641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ff08-eca0-4617-b697-2570b69605cf None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:55.838424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ff08-eca0-4617-b697-2570b69605cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:55.838717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ff08-eca0-4617-b697-2570b69605cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:55.840169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ff08-eca0-4617-b697-2570b69605cf None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:55.859064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 640/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:55.864933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e8b1c-d11b-4b90-b735-945c24094ca9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:55.969689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e8b1c-d11b-4b90-b735-945c24094ca9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:56.008459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60595b87-90ea-4f1d-92ce-e6b863f606ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:56.008993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60595b87-90ea-4f1d-92ce-e6b863f606ab None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:56.009301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60595b87-90ea-4f1d-92ce-e6b863f606ab None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:56.009550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60595b87-90ea-4f1d-92ce-e6b863f606ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:56.077579 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:56.101809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60595b87-90ea-4f1d-92ce-e6b863f606ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:56.103632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60595b87-90ea-4f1d-92ce-e6b863f606ab None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:56.223534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 615/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:37:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:37:56.229120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ff08-eca0-4617-b697-2570b69605cf None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:56.344512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ff08-eca0-4617-b697-2570b69605cf None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:56.358088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:56.381422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47170-5e05-44de-87bf-723ceebf997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:56.382313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47170-5e05-44de-87bf-723ceebf997b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:56.382588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47170-5e05-44de-87bf-723ceebf997b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:56.382889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47170-5e05-44de-87bf-723ceebf997b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:56.393752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47170-5e05-44de-87bf-723ceebf997b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:56.395360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47170-5e05-44de-87bf-723ceebf997b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-75f47170-5e05-44de-87bf-723ceebf997b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:56.416869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:56.418165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:56.419409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:56.419409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:56.419409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:56.419409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 641/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:56.425110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60595b87-90ea-4f1d-92ce-e6b863f606ab None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:56.526047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:56.540095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60595b87-90ea-4f1d-92ce-e6b863f606ab None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:56.579281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23914b-2f72-4e3d-9d19-63f5457cbebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:56.579945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23914b-2f72-4e3d-9d19-63f5457cbebb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:56.580180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23914b-2f72-4e3d-9d19-63f5457cbebb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:56.580479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23914b-2f72-4e3d-9d19-63f5457cbebb None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:56.581132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23914b-2f72-4e3d-9d19-63f5457cbebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:56.581430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23914b-2f72-4e3d-9d19-63f5457cbebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:56.583097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23914b-2f72-4e3d-9d19-63f5457cbebb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:56.596909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 616/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:56.603134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47170-5e05-44de-87bf-723ceebf997b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:56.720737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47170-5e05-44de-87bf-723ceebf997b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:56.759722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ecd9-cfa5-4ce5-85f2-2a85c78e91b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:56.760494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ecd9-cfa5-4ce5-85f2-2a85c78e91b0 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:56.760831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ecd9-cfa5-4ce5-85f2-2a85c78e91b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:56.761137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ecd9-cfa5-4ce5-85f2-2a85c78e91b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:56.769588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6ecd9-cfa5-4ce5-85f2-2a85c78e91b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:56.771802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6ecd9-cfa5-4ce5-85f2-2a85c78e91b0 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-91a6ecd9-cfa5-4ce5-85f2-2a85c78e91b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:56.785444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:56.786825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:56.787912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:56.787912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:56.787912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:56.787912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:56.787912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:56.787912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:56.787912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:56.787912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:37:56.787912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 642/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:56.793365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23914b-2f72-4e3d-9d19-63f5457cbebb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:56.909929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23914b-2f72-4e3d-9d19-63f5457cbebb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:56.949574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a5444-43e7-405c-966c-cb5abdbb3417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:56.950204 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a5444-43e7-405c-966c-cb5abdbb3417 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:56.950628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a5444-43e7-405c-966c-cb5abdbb3417 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:56.951439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a5444-43e7-405c-966c-cb5abdbb3417 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:56.952151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a5444-43e7-405c-966c-cb5abdbb3417 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:56.952453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a5444-43e7-405c-966c-cb5abdbb3417 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:56.953943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a5444-43e7-405c-966c-cb5abdbb3417 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:56.972550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 617/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:37:56.978633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ecd9-cfa5-4ce5-85f2-2a85c78e91b0 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:57.009203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:57.098631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ecd9-cfa5-4ce5-85f2-2a85c78e91b0 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:57.139962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1192e-0ec6-4119-a4bf-3c680ec12bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:57.140585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1192e-0ec6-4119-a4bf-3c680ec12bcd None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:57.140859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1192e-0ec6-4119-a4bf-3c680ec12bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:57.141127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1192e-0ec6-4119-a4bf-3c680ec12bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:57.141864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1192e-0ec6-4119-a4bf-3c680ec12bcd None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=be696635db224e3a868957eb5b5bae0e) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:57.142286 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1192e-0ec6-4119-a4bf-3c680ec12bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:57.143645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1192e-0ec6-4119-a4bf-3c680ec12bcd None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:57.149775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 643/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:37:56 2022] GET /identity/v3/role_assignments?user.id=be696635db224e3a868957eb5b5bae0e&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:59.041233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ba53-855e-427f-83b3-583a4afb5a48 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:59.041804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ba53-855e-427f-83b3-583a4afb5a48 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:59.041804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ba53-855e-427f-83b3-583a4afb5a48 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:59.043160 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 618/1261] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:59.048688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ee3a8-3402-441e-aa82-fa1ea9a06c6f None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:59.049117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ee3a8-3402-441e-aa82-fa1ea9a06c6f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:59.049243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ee3a8-3402-441e-aa82-fa1ea9a06c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:59.067794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-416ee3a8-3402-441e-aa82-fa1ea9a06c6f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:59.069238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-416ee3a8-3402-441e-aa82-fa1ea9a06c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:59.151120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 644/1262] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:59.418070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ba53-855e-427f-83b3-583a4afb5a48 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:59.429158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:59.519247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ba53-855e-427f-83b3-583a4afb5a48 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:59.551811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872f37f-9fd0-4d73-b5a7-00a770ae30df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:59.552432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872f37f-9fd0-4d73-b5a7-00a770ae30df None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:59.552708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872f37f-9fd0-4d73-b5a7-00a770ae30df None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:59.552987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872f37f-9fd0-4d73-b5a7-00a770ae30df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:59.565597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872f37f-9fd0-4d73-b5a7-00a770ae30df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5872f37f-9fd0-4d73-b5a7-00a770ae30df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:59.570288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:59.571460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:59.572627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 619/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:37:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:59.578222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ee3a8-3402-441e-aa82-fa1ea9a06c6f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:59.596614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:59.678707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ee3a8-3402-441e-aa82-fa1ea9a06c6f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:59.712120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07347f-1d7f-4871-aa8d-fd211060210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:59.712722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07347f-1d7f-4871-aa8d-fd211060210a None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:59.712998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07347f-1d7f-4871-aa8d-fd211060210a None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:59.713266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07347f-1d7f-4871-aa8d-fd211060210a None admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:59.713917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07347f-1d7f-4871-aa8d-fd211060210a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:59.714218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07347f-1d7f-4871-aa8d-fd211060210a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:59.715613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07347f-1d7f-4871-aa8d-fd211060210a None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:59.723682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 645/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:37:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:59.729493 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872f37f-9fd0-4d73-b5a7-00a770ae30df None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:59.797250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:59.831316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872f37f-9fd0-4d73-b5a7-00a770ae30df None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:59.864729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb14ee-67fd-47f3-994a-fa3bc0792d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:59.865354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb14ee-67fd-47f3-994a-fa3bc0792d5b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:59.865634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb14ee-67fd-47f3-994a-fa3bc0792d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:59.865902 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb14ee-67fd-47f3-994a-fa3bc0792d5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:59.875852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb14ee-67fd-47f3-994a-fa3bc0792d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:59.877326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb14ee-67fd-47f3-994a-fa3bc0792d5b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-01cb14ee-67fd-47f3-994a-fa3bc0792d5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:59.893168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:59.894367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:59.895609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:59.895609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:59.895609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:37:59.895609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 620/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:59.900116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07347f-1d7f-4871-aa8d-fd211060210a None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:59.982434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:00.001733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07347f-1d7f-4871-aa8d-fd211060210a None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:00.035137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e48d-761f-405c-8867-c2f4c2547c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:00.035741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e48d-761f-405c-8867-c2f4c2547c1b None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:00.036017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e48d-761f-405c-8867-c2f4c2547c1b None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:00.036284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e48d-761f-405c-8867-c2f4c2547c1b None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:00.036917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622e48d-761f-405c-8867-c2f4c2547c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:00.037217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622e48d-761f-405c-8867-c2f4c2547c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:00.038567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622e48d-761f-405c-8867-c2f4c2547c1b None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:00.051083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 646/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:00.056822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb14ee-67fd-47f3-994a-fa3bc0792d5b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:00.166029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb14ee-67fd-47f3-994a-fa3bc0792d5b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:00.188807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:00.204098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d35056-0b71-43d1-9111-1282e1259f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:00.204729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d35056-0b71-43d1-9111-1282e1259f36 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:00.205009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d35056-0b71-43d1-9111-1282e1259f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:00.205281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d35056-0b71-43d1-9111-1282e1259f36 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:00.212633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d35056-0b71-43d1-9111-1282e1259f36 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:00.214067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d35056-0b71-43d1-9111-1282e1259f36 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-76d35056-0b71-43d1-9111-1282e1259f36 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:38:00.225502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:00.230934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:38:00.232090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 621/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:38:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:00.233191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e48d-761f-405c-8867-c2f4c2547c1b None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:00.334818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e48d-761f-405c-8867-c2f4c2547c1b None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:00.369464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50615d81-e3ea-48a7-b13c-9aaf8eb939c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:00.370069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50615d81-e3ea-48a7-b13c-9aaf8eb939c3 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:00.370348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50615d81-e3ea-48a7-b13c-9aaf8eb939c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:00.370620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50615d81-e3ea-48a7-b13c-9aaf8eb939c3 None admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:00.371379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50615d81-e3ea-48a7-b13c-9aaf8eb939c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:00.371684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50615d81-e3ea-48a7-b13c-9aaf8eb939c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:00.374194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50615d81-e3ea-48a7-b13c-9aaf8eb939c3 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:00.383047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:00.392620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 647/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Aug 18 20:38:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:00.398316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d35056-0b71-43d1-9111-1282e1259f36 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:00.502456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d35056-0b71-43d1-9111-1282e1259f36 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:00.534828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175fded-ac64-43c1-8bfe-8ec0676a9238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:00.535446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175fded-ac64-43c1-8bfe-8ec0676a9238 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:00.535723 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175fded-ac64-43c1-8bfe-8ec0676a9238 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:00.535990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175fded-ac64-43c1-8bfe-8ec0676a9238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:00.546728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175fded-ac64-43c1-8bfe-8ec0676a9238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:00.548194 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175fded-ac64-43c1-8bfe-8ec0676a9238 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5175fded-ac64-43c1-8bfe-8ec0676a9238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:38:00.562883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:00.564066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:38:00.564991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:38:00.564991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:38:00.564991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:38:00.564991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 622/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:00.570110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50615d81-e3ea-48a7-b13c-9aaf8eb939c3 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:00.670851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50615d81-e3ea-48a7-b13c-9aaf8eb939c3 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:00.704228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d66ac9-9ad1-4e9a-aa4d-6267a04897fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:00.704841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66ac9-9ad1-4e9a-aa4d-6267a04897fe None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:00.705121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66ac9-9ad1-4e9a-aa4d-6267a04897fe None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:00.705393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66ac9-9ad1-4e9a-aa4d-6267a04897fe None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:00.706031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d66ac9-9ad1-4e9a-aa4d-6267a04897fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:00.706333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d66ac9-9ad1-4e9a-aa4d-6267a04897fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:00.707730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d66ac9-9ad1-4e9a-aa4d-6267a04897fe None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:00.719985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 648/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:00.725820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175fded-ac64-43c1-8bfe-8ec0676a9238 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:00.757445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:00.826186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175fded-ac64-43c1-8bfe-8ec0676a9238 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:00.859286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa192bfa-61f3-49f1-b39e-580f71eaf74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:00.859907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa192bfa-61f3-49f1-b39e-580f71eaf74c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:00.860188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa192bfa-61f3-49f1-b39e-580f71eaf74c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:00.860458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa192bfa-61f3-49f1-b39e-580f71eaf74c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:00.866917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa192bfa-61f3-49f1-b39e-580f71eaf74c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:00.868363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa192bfa-61f3-49f1-b39e-580f71eaf74c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-aa192bfa-61f3-49f1-b39e-580f71eaf74c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:38:00.879905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:00.880989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:00.882450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:38:00.882450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:38:00.882450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:38:00.882450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:38:00.882450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:38:00.882450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:38:00.882450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:38:00.882450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:38:00.882450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 623/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:00.889546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d66ac9-9ad1-4e9a-aa4d-6267a04897fe None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:00.948659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:00.990219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d66ac9-9ad1-4e9a-aa4d-6267a04897fe None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:01.023623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7d992-1c8a-41bf-b3cb-1cbd0694ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:01.024148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7d992-1c8a-41bf-b3cb-1cbd0694ad7c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:01.024421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7d992-1c8a-41bf-b3cb-1cbd0694ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:01.024688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7d992-1c8a-41bf-b3cb-1cbd0694ad7c None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:01.025371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7d992-1c8a-41bf-b3cb-1cbd0694ad7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:01.025680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7d992-1c8a-41bf-b3cb-1cbd0694ad7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:01.027128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7d992-1c8a-41bf-b3cb-1cbd0694ad7c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:01.039445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 649/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:01.046341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa192bfa-61f3-49f1-b39e-580f71eaf74c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:01.147810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:01.157517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa192bfa-61f3-49f1-b39e-580f71eaf74c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:01.196313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a675e-64ed-4da3-a290-1be95e27be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:01.196985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a675e-64ed-4da3-a290-1be95e27be4a None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:01.197263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a675e-64ed-4da3-a290-1be95e27be4a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:01.197536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a675e-64ed-4da3-a290-1be95e27be4a None admin] PATH_INFO: `/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/be696635db224e3a868957eb5b5bae0e/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:01.199572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a675e-64ed-4da3-a290-1be95e27be4a None admin] RBAC: Authorizing `identity:create_grant(project_id=72de7783af3347fcb7d71d07be86d2aa, user_id=be696635db224e3a868957eb5b5bae0e, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:01.201720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a675e-64ed-4da3-a290-1be95e27be4a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:01.214566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 624/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Aug 18 20:38:01 2022] PUT /identity/v3/projects/72de7783af3347fcb7d71d07be86d2aa/users/be696635db224e3a868957eb5b5bae0e/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:38:03.133471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8216-be07-4f80-b395-630766ea461a None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:03.134040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8216-be07-4f80-b395-630766ea461a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:03.134040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8216-be07-4f80-b395-630766ea461a None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:03.135397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 650/1274] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:38:03.141041 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1bed-614b-4c08-8bf6-b24d9a684773 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:03.141449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1bed-614b-4c08-8bf6-b24d9a684773 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:03.141599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1bed-614b-4c08-8bf6-b24d9a684773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:03.159903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-dc9d1bed-614b-4c08-8bf6-b24d9a684773 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:38:03.161096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-dc9d1bed-614b-4c08-8bf6-b24d9a684773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:38:03.226164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 625/1275] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:38:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:38:03.500343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8216-be07-4f80-b395-630766ea461a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:03.602042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8216-be07-4f80-b395-630766ea461a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:03.620585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:03.637349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35483217-4f4b-4e53-a479-97d25aee6464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:03.638595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35483217-4f4b-4e53-a479-97d25aee6464 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:03.638967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35483217-4f4b-4e53-a479-97d25aee6464 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:03.639236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35483217-4f4b-4e53-a479-97d25aee6464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:03.649105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35483217-4f4b-4e53-a479-97d25aee6464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-35483217-4f4b-4e53-a479-97d25aee6464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:38:03.654439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:03.655575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:03.656647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 651/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Aug 18 20:38:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:03.661644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d1bed-614b-4c08-8bf6-b24d9a684773 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:03.740510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:03.760066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d1bed-614b-4c08-8bf6-b24d9a684773 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:03.792907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8f040-27c7-4f78-adce-2e4f8a984ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:03.793502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f040-27c7-4f78-adce-2e4f8a984ed7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:03.793778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f040-27c7-4f78-adce-2e4f8a984ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:03.794082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f040-27c7-4f78-adce-2e4f8a984ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:03.794898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8f040-27c7-4f78-adce-2e4f8a984ed7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:03.795197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8f040-27c7-4f78-adce-2e4f8a984ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:03.796559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8f040-27c7-4f78-adce-2e4f8a984ed7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:03.804598 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 626/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Aug 18 20:38:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:03.811043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35483217-4f4b-4e53-a479-97d25aee6464 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:03.913680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35483217-4f4b-4e53-a479-97d25aee6464 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:03.951866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a187ef1-994c-48f1-b1bf-baa14a8d9c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:03.952492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a187ef1-994c-48f1-b1bf-baa14a8d9c96 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:03.952774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a187ef1-994c-48f1-b1bf-baa14a8d9c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:03.953050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a187ef1-994c-48f1-b1bf-baa14a8d9c96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:03.962805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a187ef1-994c-48f1-b1bf-baa14a8d9c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:03.964250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a187ef1-994c-48f1-b1bf-baa14a8d9c96 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-2a187ef1-994c-48f1-b1bf-baa14a8d9c96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:38:03.978995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:03.980163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:38:03.981257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:38:03.981257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:38:03.981257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:03.981257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 652/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:03.986056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8f040-27c7-4f78-adce-2e4f8a984ed7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:04.093467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8f040-27c7-4f78-adce-2e4f8a984ed7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:04.135522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832f6ff-0175-43f1-839b-067c4cfd8e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:04.136200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f6ff-0175-43f1-839b-067c4cfd8e4f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:04.136483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f6ff-0175-43f1-839b-067c4cfd8e4f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:04.136769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f6ff-0175-43f1-839b-067c4cfd8e4f None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:04.137440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832f6ff-0175-43f1-839b-067c4cfd8e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:04.137803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832f6ff-0175-43f1-839b-067c4cfd8e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:04.139279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832f6ff-0175-43f1-839b-067c4cfd8e4f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:04.151954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 627/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:04.157813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a187ef1-994c-48f1-b1bf-baa14a8d9c96 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:04.188946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:04.257459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a187ef1-994c-48f1-b1bf-baa14a8d9c96 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:04.290000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c032dd-6e79-4118-a4da-135c7271bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:04.290625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c032dd-6e79-4118-a4da-135c7271bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:04.290938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c032dd-6e79-4118-a4da-135c7271bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:04.291212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c032dd-6e79-4118-a4da-135c7271bfd2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:04.298982 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c032dd-6e79-4118-a4da-135c7271bfd2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:04.300411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c032dd-6e79-4118-a4da-135c7271bfd2 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-79c032dd-6e79-4118-a4da-135c7271bfd2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:38:04.311966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:04.313124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:04.314330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 653/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:38:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:04.318949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832f6ff-0175-43f1-839b-067c4cfd8e4f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:04.322672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:04.417367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832f6ff-0175-43f1-839b-067c4cfd8e4f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:04.451733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f2952-87b4-4e5b-9f81-c620947ffc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:04.452340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f2952-87b4-4e5b-9f81-c620947ffc5e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:04.452624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f2952-87b4-4e5b-9f81-c620947ffc5e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:04.452901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f2952-87b4-4e5b-9f81-c620947ffc5e None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:04.453628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f2952-87b4-4e5b-9f81-c620947ffc5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:04.453940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f2952-87b4-4e5b-9f81-c620947ffc5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:04.455415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f2952-87b4-4e5b-9f81-c620947ffc5e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:04.473958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 628/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Aug 18 20:38:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:04.479789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c032dd-6e79-4118-a4da-135c7271bfd2 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:04.570246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:04.580430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c032dd-6e79-4118-a4da-135c7271bfd2 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:04.617116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420a3c2-bec4-4ac9-80fb-fd544c09c030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:04.617724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420a3c2-bec4-4ac9-80fb-fd544c09c030 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:04.618003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420a3c2-bec4-4ac9-80fb-fd544c09c030 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:04.618274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420a3c2-bec4-4ac9-80fb-fd544c09c030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:04.687904 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420a3c2-bec4-4ac9-80fb-fd544c09c030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:04.689344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420a3c2-bec4-4ac9-80fb-fd544c09c030 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:04.781519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:04.792118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 654/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Aug 18 20:38:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:38:04.798524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f2952-87b4-4e5b-9f81-c620947ffc5e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:04.860451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:04.899072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f2952-87b4-4e5b-9f81-c620947ffc5e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:04.932887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cdd57-55ca-4ac2-856a-e95a746130ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:04.933513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cdd57-55ca-4ac2-856a-e95a746130ba None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:04.933790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cdd57-55ca-4ac2-856a-e95a746130ba None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:04.934060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cdd57-55ca-4ac2-856a-e95a746130ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:04.944206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cdd57-55ca-4ac2-856a-e95a746130ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:04.945588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cdd57-55ca-4ac2-856a-e95a746130ba None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-c91cdd57-55ca-4ac2-856a-e95a746130ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:38:04.960673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:04.961898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:38:04.963027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:38:04.963027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:38:04.963027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:38:04.963027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 629/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:04.968262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420a3c2-bec4-4ac9-80fb-fd544c09c030 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:05.067374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420a3c2-bec4-4ac9-80fb-fd544c09c030 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:05.107261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896e7fa-b296-4a1d-9f64-307728510c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:05.107873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e7fa-b296-4a1d-9f64-307728510c89 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:05.108151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e7fa-b296-4a1d-9f64-307728510c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:05.108419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e7fa-b296-4a1d-9f64-307728510c89 None admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:05.109057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e7fa-b296-4a1d-9f64-307728510c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:05.109360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e7fa-b296-4a1d-9f64-307728510c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:05.110718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e7fa-b296-4a1d-9f64-307728510c89 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:05.121794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 655/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Aug 18 20:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:05.127490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cdd57-55ca-4ac2-856a-e95a746130ba None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:05.227411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cdd57-55ca-4ac2-856a-e95a746130ba None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:05.240640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:05.261656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa1e15-ec01-459d-8cf2-9e444098e018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:05.262278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa1e15-ec01-459d-8cf2-9e444098e018 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:05.263046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa1e15-ec01-459d-8cf2-9e444098e018 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:05.263161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa1e15-ec01-459d-8cf2-9e444098e018 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:05.269688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa1e15-ec01-459d-8cf2-9e444098e018 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:05.271203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa1e15-ec01-459d-8cf2-9e444098e018 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-a7fa1e15-ec01-459d-8cf2-9e444098e018 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:38:05.282610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:05.283675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:05.284805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:38:05.284805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:38:05.284805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:38:05.284805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:38:05.284805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:38:05.284805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:38:05.284805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:38:05.284805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 18 20:38:05.284805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 630/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Aug 18 20:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:05.289840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896e7fa-b296-4a1d-9f64-307728510c89 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:05.339235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:05.390779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896e7fa-b296-4a1d-9f64-307728510c89 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:05.423947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249715b8-cfcc-41c4-9578-badd62e2ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:05.424550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249715b8-cfcc-41c4-9578-badd62e2ee6c None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:05.424829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249715b8-cfcc-41c4-9578-badd62e2ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:05.425103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249715b8-cfcc-41c4-9578-badd62e2ee6c None admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:05.425789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249715b8-cfcc-41c4-9578-badd62e2ee6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:05.426092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249715b8-cfcc-41c4-9578-badd62e2ee6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:05.427543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249715b8-cfcc-41c4-9578-badd62e2ee6c None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:05.439780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 656/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Aug 18 20:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:05.445899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa1e15-ec01-459d-8cf2-9e444098e018 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:05.543735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa1e15-ec01-459d-8cf2-9e444098e018 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:05.578912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14104-cbe1-4427-a736-b39e60c910ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:05.579514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14104-cbe1-4427-a736-b39e60c910ee None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:05.579793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14104-cbe1-4427-a736-b39e60c910ee None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:05.580061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14104-cbe1-4427-a736-b39e60c910ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:05.580783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14104-cbe1-4427-a736-b39e60c910ee None admin] RBAC: Adding query filter params (role.id=3eb3a11165ab4369b2f88a4dc9cc7d60, scope.project.id=72de7783af3347fcb7d71d07be86d2aa, user.id=be696635db224e3a868957eb5b5bae0e) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:05.581090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14104-cbe1-4427-a736-b39e60c910ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:05.582520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14104-cbe1-4427-a736-b39e60c910ee None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:05.588272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 631/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Aug 18 20:38:05 2022] GET /identity/v3/role_assignments?user.id=be696635db224e3a868957eb5b5bae0e&scope.project.id=72de7783af3347fcb7d71d07be86d2aa&role.id=3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:07.534140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a878d-0ffa-4224-a5f9-515dd0d2a6a4 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:07.534679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a878d-0ffa-4224-a5f9-515dd0d2a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:07.534679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a878d-0ffa-4224-a5f9-515dd0d2a6a4 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:07.536060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 657/1288] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:38:07.541382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc047f-cfe3-4a49-9bbc-9dba6ee5c7ad None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:07.541821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc047f-cfe3-4a49-9bbc-9dba6ee5c7ad None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:07.541935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc047f-cfe3-4a49-9bbc-9dba6ee5c7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:07.560801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a1fc047f-cfe3-4a49-9bbc-9dba6ee5c7ad None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:38:07.561979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a1fc047f-cfe3-4a49-9bbc-9dba6ee5c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:38:07.592294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:07.631221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 632/1289] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:38:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:38:07.906687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a878d-0ffa-4224-a5f9-515dd0d2a6a4 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:08.013423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a878d-0ffa-4224-a5f9-515dd0d2a6a4 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:08.023903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:08.047561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5acf-63c6-4897-b052-9313d83c128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:08.048193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5acf-63c6-4897-b052-9313d83c128f None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:08.048464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5acf-63c6-4897-b052-9313d83c128f None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:08.048729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5acf-63c6-4897-b052-9313d83c128f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:08.049298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b5acf-63c6-4897-b052-9313d83c128f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:08.050660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b5acf-63c6-4897-b052-9313d83c128f None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-1d5b5acf-63c6-4897-b052-9313d83c128f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:08.059153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:08.060402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:08.061336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 658/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:38:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:08.066947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc047f-cfe3-4a49-9bbc-9dba6ee5c7ad None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:08.189735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc047f-cfe3-4a49-9bbc-9dba6ee5c7ad None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:08.223930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d6460-91ae-4826-8b99-3f95d811dabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:08.224527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d6460-91ae-4826-8b99-3f95d811dabc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:08.224802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d6460-91ae-4826-8b99-3f95d811dabc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:08.225069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d6460-91ae-4826-8b99-3f95d811dabc None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:08.225685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d6460-91ae-4826-8b99-3f95d811dabc None admin] RBAC: Adding query filter params (name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:08.225982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d6460-91ae-4826-8b99-3f95d811dabc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:08.227383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d6460-91ae-4826-8b99-3f95d811dabc None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:08.232852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 633/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Aug 18 20:38:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:08.238633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5acf-63c6-4897-b052-9313d83c128f None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:08.338526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5acf-63c6-4897-b052-9313d83c128f None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:08.373094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56fd6c-e3f8-4ada-8b59-aaf368cfdab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:08.373699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56fd6c-e3f8-4ada-8b59-aaf368cfdab1 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:08.373974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56fd6c-e3f8-4ada-8b59-aaf368cfdab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:08.374249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56fd6c-e3f8-4ada-8b59-aaf368cfdab1 None admin] PATH_INFO: `/v3/services` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:08.374924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56fd6c-e3f8-4ada-8b59-aaf368cfdab1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:08.375232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56fd6c-e3f8-4ada-8b59-aaf368cfdab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:08.376588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56fd6c-e3f8-4ada-8b59-aaf368cfdab1 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:08.380940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 659/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Aug 18 20:38:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:10.316868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d628e9-c58c-47c6-b34a-75a6fddb69fb None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:10.317509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d628e9-c58c-47c6-b34a-75a6fddb69fb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:10.317509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d628e9-c58c-47c6-b34a-75a6fddb69fb None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:10.318748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 634/1293] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:38:10.323924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6b593-96c7-4de9-b940-44684911f12f None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:10.324304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6b593-96c7-4de9-b940-44684911f12f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:10.324485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6b593-96c7-4de9-b940-44684911f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:10.343554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0de6b593-96c7-4de9-b940-44684911f12f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:38:10.344758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0de6b593-96c7-4de9-b940-44684911f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:38:10.374178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:10.412325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 660/1294] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:38:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:38:10.685305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d628e9-c58c-47c6-b34a-75a6fddb69fb None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:10.715212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:10.785061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d628e9-c58c-47c6-b34a-75a6fddb69fb None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:10.818873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f3f0-ba27-4957-afcd-60df5d0bddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:10.819476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f3f0-ba27-4957-afcd-60df5d0bddc4 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:10.819752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f3f0-ba27-4957-afcd-60df5d0bddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:10.820018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f3f0-ba27-4957-afcd-60df5d0bddc4 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:10.820647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682f3f0-ba27-4957-afcd-60df5d0bddc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:10.822013 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682f3f0-ba27-4957-afcd-60df5d0bddc4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:10.837073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 635/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Aug 18 20:38:10 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:38:12.747975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281562-bae6-428a-9056-53b17b2f15aa None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:12.748499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281562-bae6-428a-9056-53b17b2f15aa None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:12.748499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281562-bae6-428a-9056-53b17b2f15aa None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:12.749847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 661/1296] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:38:12.754980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb6fb8-12f8-490d-8c36-f6dc853b5222 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:12.755425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb6fb8-12f8-490d-8c36-f6dc853b5222 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:12.755520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb6fb8-12f8-490d-8c36-f6dc853b5222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:12.773584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8dcb6fb8-12f8-490d-8c36-f6dc853b5222 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:38:12.774804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8dcb6fb8-12f8-490d-8c36-f6dc853b5222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:38:12.845853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 636/1297] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:38:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:38:13.120842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2281562-bae6-428a-9056-53b17b2f15aa None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:13.226878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2281562-bae6-428a-9056-53b17b2f15aa None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:13.260762 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5722f5-73b1-4b7c-8345-da573be027e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:13.261391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5722f5-73b1-4b7c-8345-da573be027e3 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:13.261672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5722f5-73b1-4b7c-8345-da573be027e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:13.261950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5722f5-73b1-4b7c-8345-da573be027e3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:13.262677 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5722f5-73b1-4b7c-8345-da573be027e3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:13.264073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5722f5-73b1-4b7c-8345-da573be027e3 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-ca5722f5-73b1-4b7c-8345-da573be027e3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:13.272636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:13.273645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:13.274610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 662/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:38:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:38:13.279994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb6fb8-12f8-490d-8c36-f6dc853b5222 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:13.298330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:13.378359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb6fb8-12f8-490d-8c36-f6dc853b5222 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:13.411203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350c95b-6c17-4f3f-bd38-0592f51a717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:13.411804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350c95b-6c17-4f3f-bd38-0592f51a717d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:13.412083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350c95b-6c17-4f3f-bd38-0592f51a717d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:13.412352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350c95b-6c17-4f3f-bd38-0592f51a717d None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:13.412975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350c95b-6c17-4f3f-bd38-0592f51a717d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:13.413276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350c95b-6c17-4f3f-bd38-0592f51a717d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:13.414649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350c95b-6c17-4f3f-bd38-0592f51a717d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:13.420480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 637/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Aug 18 20:38:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:13.426610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5722f5-73b1-4b7c-8345-da573be027e3 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:13.459107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:13.527093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5722f5-73b1-4b7c-8345-da573be027e3 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:13.560794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbc94a-3e07-432a-9a14-44f621381480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:13.561401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbc94a-3e07-432a-9a14-44f621381480 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:13.561679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbc94a-3e07-432a-9a14-44f621381480 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:13.561953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbc94a-3e07-432a-9a14-44f621381480 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:13.562656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbc94a-3e07-432a-9a14-44f621381480 None admin] RBAC: Adding query filter params (interface=public, service_id=064bfa5723f94eb493a3bdea8ca83c61, region_id=RegionOne) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:13.562994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbc94a-3e07-432a-9a14-44f621381480 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:13.564362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbc94a-3e07-432a-9a14-44f621381480 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:13.569457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 663/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Aug 18 20:38:13 2022] GET /identity/v3/endpoints?service_id=064bfa5723f94eb493a3bdea8ca83c61&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:13.575431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350c95b-6c17-4f3f-bd38-0592f51a717d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:13.659882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:13.679251 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350c95b-6c17-4f3f-bd38-0592f51a717d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:13.713239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a63608-9510-4e25-a2b6-463a2c9f768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:13.713856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a63608-9510-4e25-a2b6-463a2c9f768a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:13.714139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a63608-9510-4e25-a2b6-463a2c9f768a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:13.714412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a63608-9510-4e25-a2b6-463a2c9f768a None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:13.715039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a63608-9510-4e25-a2b6-463a2c9f768a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:13.717246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a63608-9510-4e25-a2b6-463a2c9f768a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:13.723879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 638/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Aug 18 20:38:13 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:38:15.657779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b126b-d51b-4c0a-8135-8d3b55430813 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:15.658366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b126b-d51b-4c0a-8135-8d3b55430813 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:15.658366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b126b-d51b-4c0a-8135-8d3b55430813 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:15.659672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 664/1302] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:38:15.664799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d1511-917b-4b48-8fb9-ef2d0514730b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:15.665218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d1511-917b-4b48-8fb9-ef2d0514730b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:15.665353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d1511-917b-4b48-8fb9-ef2d0514730b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:15.683758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c89d1511-917b-4b48-8fb9-ef2d0514730b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:38:15.685904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c89d1511-917b-4b48-8fb9-ef2d0514730b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:38:15.752662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 639/1303] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:38:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:38:16.017442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b126b-d51b-4c0a-8135-8d3b55430813 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:16.114270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:16.121197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b126b-d51b-4c0a-8135-8d3b55430813 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:16.154680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86af794-6121-4e8f-8986-a4e3e1737396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:16.155336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86af794-6121-4e8f-8986-a4e3e1737396 None admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:16.155614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86af794-6121-4e8f-8986-a4e3e1737396 None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:16.155882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86af794-6121-4e8f-8986-a4e3e1737396 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:16.156458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86af794-6121-4e8f-8986-a4e3e1737396 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:16.157811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86af794-6121-4e8f-8986-a4e3e1737396 None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application [None req-a86af794-6121-4e8f-8986-a4e3e1737396 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:38:16.166404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:38:16.167612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application with Lock( Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: ERROR keystone.server.flask.application Aug 18 20:38:16.168638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 665/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Aug 18 20:38:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:38:16.173933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d1511-917b-4b48-8fb9-ef2d0514730b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:16.251270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:16.274930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d1511-917b-4b48-8fb9-ef2d0514730b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:16.309049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa064d8-2e40-4ab0-a0f2-3936e04a1356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:16.309652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa064d8-2e40-4ab0-a0f2-3936e04a1356 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:16.309927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa064d8-2e40-4ab0-a0f2-3936e04a1356 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:16.310192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa064d8-2e40-4ab0-a0f2-3936e04a1356 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:16.310829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa064d8-2e40-4ab0-a0f2-3936e04a1356 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:38:16.311130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa064d8-2e40-4ab0-a0f2-3936e04a1356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:16.312488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa064d8-2e40-4ab0-a0f2-3936e04a1356 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:16.317523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 640/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Aug 18 20:38:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:38:16.323340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86af794-6121-4e8f-8986-a4e3e1737396 None admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:38:16.423816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86af794-6121-4e8f-8986-a4e3e1737396 None admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:38:16.457812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861b1c5-c888-4889-8cd9-753e702c73da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:38:16.458421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861b1c5-c888-4889-8cd9-753e702c73da None admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:38:16.458702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861b1c5-c888-4889-8cd9-753e702c73da None admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:38:16.459100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861b1c5-c888-4889-8cd9-753e702c73da None admin] PATH_INFO: `/v3/endpoints` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:38:16.459775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861b1c5-c888-4889-8cd9-753e702c73da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:38:16.461132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861b1c5-c888-4889-8cd9-753e702c73da None admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:38:16.482791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 666/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:38:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:38:26.314531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=30 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:26.477468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:21.532832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ba526-5e28-49ef-8fcb-e6a46fb70df4 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:21.533399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ba526-5e28-49ef-8fcb-e6a46fb70df4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:21.533399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ba526-5e28-49ef-8fcb-e6a46fb70df4 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:21.538793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 641/1307] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:21.540315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad620d-cc9d-40e4-8c42-9273f9315cf8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:21.540785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad620d-cc9d-40e4-8c42-9273f9315cf8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:21.540870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad620d-cc9d-40e4-8c42-9273f9315cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:21.731853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-45ad620d-cc9d-40e4-8c42-9273f9315cf8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:21.735027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-45ad620d-cc9d-40e4-8c42-9273f9315cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:21.945689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 667/1308] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:39:22.249569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb4fa-8d36-4dca-a2c4-506a1a973e67 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:22.250228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb4fa-8d36-4dca-a2c4-506a1a973e67 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:22.250696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb4fa-8d36-4dca-a2c4-506a1a973e67 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:22.252778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 642/1309] 10.222.0.65 () {54 vars in 965 bytes} [Thu Aug 18 20:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:22.260598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ead21-f466-4d1a-a23f-e7ddb054d089 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:22.261569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ead21-f466-4d1a-a23f-e7ddb054d089 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:22.262130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ead21-f466-4d1a-a23f-e7ddb054d089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:22.359000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3f5ead21-f466-4d1a-a23f-e7ddb054d089 None None] MFA Rules not processed for user `c13c571a4bd24335b8b149825bd79d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:22.361004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3f5ead21-f466-4d1a-a23f-e7ddb054d089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:22.389764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:22.474042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb4fa-8d36-4dca-a2c4-506a1a973e67 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:22.476451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a11eb4fa-8d36-4dca-a2c4-506a1a973e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:22.485247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 668/1310] 10.222.0.65 () {58 vars in 1062 bytes} [Thu Aug 18 20:39:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:22.621763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb4fa-8d36-4dca-a2c4-506a1a973e67 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:22.709746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf6e0f-c597-40fa-a5f1-fb30be641351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:22.710720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf6e0f-c597-40fa-a5f1-fb30be641351 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:22.711257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf6e0f-c597-40fa-a5f1-fb30be641351 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:22.711733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf6e0f-c597-40fa-a5f1-fb30be641351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:22.714651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9ecf6e0f-c597-40fa-a5f1-fb30be641351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:22.786666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:22.863718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf6e0f-c597-40fa-a5f1-fb30be641351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:22.865353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf6e0f-c597-40fa-a5f1-fb30be641351 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:22.903322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 643/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:25.194389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa4007-4a1d-4760-9870-e97090a560db None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:25.194890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa4007-4a1d-4760-9870-e97090a560db None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:25.194981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa4007-4a1d-4760-9870-e97090a560db None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:25.196311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 669/1312] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:25.202237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef1f9c-04e4-4f81-959f-7dfbaf4b6450 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:25.202649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef1f9c-04e4-4f81-959f-7dfbaf4b6450 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:25.202966 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef1f9c-04e4-4f81-959f-7dfbaf4b6450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:25.274201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1eef1f9c-04e4-4f81-959f-7dfbaf4b6450 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:25.275452 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1eef1f9c-04e4-4f81-959f-7dfbaf4b6450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:25.374428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 644/1313] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:25.676130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542198f-f67e-48ef-9046-dd2ca7f532fa None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:25.676394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542198f-f67e-48ef-9046-dd2ca7f532fa None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:25.676669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542198f-f67e-48ef-9046-dd2ca7f532fa None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:25.678010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 670/1314] 10.222.0.65 () {54 vars in 965 bytes} [Thu Aug 18 20:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:25.685036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9de5f-8f6e-4ffa-98e8-c2429706b992 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:25.685237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9de5f-8f6e-4ffa-98e8-c2429706b992 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:25.685517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9de5f-8f6e-4ffa-98e8-c2429706b992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:25.697222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:25.761561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-43e9de5f-8f6e-4ffa-98e8-c2429706b992 None None] MFA Rules not processed for user `c13c571a4bd24335b8b149825bd79d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:25.762800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-43e9de5f-8f6e-4ffa-98e8-c2429706b992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:25.838638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 645/1315] 10.222.0.65 () {58 vars in 1062 bytes} [Thu Aug 18 20:39:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:25.847968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542198f-f67e-48ef-9046-dd2ca7f532fa None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:25.849444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d542198f-f67e-48ef-9046-dd2ca7f532fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:25.957708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542198f-f67e-48ef-9046-dd2ca7f532fa None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:26.028595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:26.031382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080ec8-31bb-46eb-8d5a-7038d9eaf9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:26.032272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080ec8-31bb-46eb-8d5a-7038d9eaf9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:26.032647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080ec8-31bb-46eb-8d5a-7038d9eaf9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:26.033164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080ec8-31bb-46eb-8d5a-7038d9eaf9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:26.035043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0d080ec8-31bb-46eb-8d5a-7038d9eaf9c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:26.148848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d080ec8-31bb-46eb-8d5a-7038d9eaf9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:26.150187 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d080ec8-31bb-46eb-8d5a-7038d9eaf9c0 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:26.168822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 671/1316] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:39:28.863135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce710355-55e9-4360-9fac-744fcd8c05ff None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:28.863733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce710355-55e9-4360-9fac-744fcd8c05ff None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:28.863733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce710355-55e9-4360-9fac-744fcd8c05ff None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:28.865421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 646/1317] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:28.872123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b9153-d3ba-499a-a95c-3caf280c8bf6 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:28.872619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b9153-d3ba-499a-a95c-3caf280c8bf6 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:28.872725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b9153-d3ba-499a-a95c-3caf280c8bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:28.948319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ed7b9153-d3ba-499a-a95c-3caf280c8bf6 None None] MFA Rules not processed for user `71a15ac6f0154871b851e8c126489c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:28.949278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ed7b9153-d3ba-499a-a95c-3caf280c8bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:29.000885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:29.046259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 672/1318] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:29.339277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce710355-55e9-4360-9fac-744fcd8c05ff None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:29.340826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ce710355-55e9-4360-9fac-744fcd8c05ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:29.444413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce710355-55e9-4360-9fac-744fcd8c05ff None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:29.447205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:29.518528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08354f8b-0c99-45e3-9a38-d51746344953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:29.519164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08354f8b-0c99-45e3-9a38-d51746344953 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:29.519443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08354f8b-0c99-45e3-9a38-d51746344953 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:29.519711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08354f8b-0c99-45e3-9a38-d51746344953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:29.521307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-08354f8b-0c99-45e3-9a38-d51746344953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:29.630777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08354f8b-0c99-45e3-9a38-d51746344953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:29.632510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08354f8b-0c99-45e3-9a38-d51746344953 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:29.661127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 647/1319] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:32.175555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0f57b-30f9-431a-8b8b-2b683684615f None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:32.176132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0f57b-30f9-431a-8b8b-2b683684615f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:32.176132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0f57b-30f9-431a-8b8b-2b683684615f None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:32.177468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 673/1320] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:32.182985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a38a-6b6d-45b2-a327-6ac0c4e20898 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:32.183446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a38a-6b6d-45b2-a327-6ac0c4e20898 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:32.183544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a38a-6b6d-45b2-a327-6ac0c4e20898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:32.231793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:32.258790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5ad6a38a-6b6d-45b2-a327-6ac0c4e20898 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:32.260508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5ad6a38a-6b6d-45b2-a327-6ac0c4e20898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:32.364891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 648/1321] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:32.652195 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0f57b-30f9-431a-8b8b-2b683684615f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:32.653766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b9c0f57b-30f9-431a-8b8b-2b683684615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:32.756548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0f57b-30f9-431a-8b8b-2b683684615f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:32.832355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5bdae-0011-4808-9d9c-34e7bb49d806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:32.832958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5bdae-0011-4808-9d9c-34e7bb49d806 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:32.833236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5bdae-0011-4808-9d9c-34e7bb49d806 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:32.833516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5bdae-0011-4808-9d9c-34e7bb49d806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:32.835139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2eb5bdae-0011-4808-9d9c-34e7bb49d806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:32.843789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:32.951729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5bdae-0011-4808-9d9c-34e7bb49d806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:32.953079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5bdae-0011-4808-9d9c-34e7bb49d806 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:32.972546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 674/1322] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:35.590232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd2cff-ed14-405a-a2df-baf668c25e8b None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:35.590815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd2cff-ed14-405a-a2df-baf668c25e8b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:35.590815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd2cff-ed14-405a-a2df-baf668c25e8b None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:35.592326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 649/1323] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:35.597566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ab278-789f-4076-81fd-82fd58e6dfaa None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:35.597984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ab278-789f-4076-81fd-82fd58e6dfaa None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:35.598125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ab278-789f-4076-81fd-82fd58e6dfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:35.666681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f66ab278-789f-4076-81fd-82fd58e6dfaa None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:35.668100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f66ab278-789f-4076-81fd-82fd58e6dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:35.727546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:35.768132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 675/1324] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:36.052673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd2cff-ed14-405a-a2df-baf668c25e8b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:36.054299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cffd2cff-ed14-405a-a2df-baf668c25e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:36.160809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd2cff-ed14-405a-a2df-baf668c25e8b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:36.173741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:36.238194 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f14ea-564a-46ac-897e-08b95147e5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:36.238694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f14ea-564a-46ac-897e-08b95147e5fa service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:36.238997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f14ea-564a-46ac-897e-08b95147e5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:36.239263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f14ea-564a-46ac-897e-08b95147e5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:36.240839 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-628f14ea-564a-46ac-897e-08b95147e5fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:36.351266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f14ea-564a-46ac-897e-08b95147e5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:36.352732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f14ea-564a-46ac-897e-08b95147e5fa service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:36.372645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 650/1325] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:38.334276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91a47-4a42-4d59-8b01-f0e34f2f9526 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:38.334859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91a47-4a42-4d59-8b01-f0e34f2f9526 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:38.334859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91a47-4a42-4d59-8b01-f0e34f2f9526 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:38.336194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 676/1326] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:38.341907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c406f1-e9ae-4aae-9dde-6c8f3be73d83 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:38.342351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c406f1-e9ae-4aae-9dde-6c8f3be73d83 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:38.342549 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c406f1-e9ae-4aae-9dde-6c8f3be73d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:38.396370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:38.415876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-10c406f1-e9ae-4aae-9dde-6c8f3be73d83 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:38.417694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-10c406f1-e9ae-4aae-9dde-6c8f3be73d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:38.515820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 651/1327] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:38.799004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91a47-4a42-4d59-8b01-f0e34f2f9526 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:38.800652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-54a91a47-4a42-4d59-8b01-f0e34f2f9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:38.911120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91a47-4a42-4d59-8b01-f0e34f2f9526 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:39.003064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb59c20-72d1-4289-9e67-85b58178a516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:39.003745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb59c20-72d1-4289-9e67-85b58178a516 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:39.004028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb59c20-72d1-4289-9e67-85b58178a516 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:39.004302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb59c20-72d1-4289-9e67-85b58178a516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:39.005915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-acb59c20-72d1-4289-9e67-85b58178a516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:39.023359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:39.121764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb59c20-72d1-4289-9e67-85b58178a516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:39.123807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb59c20-72d1-4289-9e67-85b58178a516 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:39.145333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 677/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:41.134335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094dbdd-0a80-4683-a54a-085d0538ba70 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:41.135364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094dbdd-0a80-4683-a54a-085d0538ba70 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:41.136191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094dbdd-0a80-4683-a54a-085d0538ba70 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:41.137591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 652/1329] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:41.147154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e64de-0b78-47e3-9d5d-7442f0dc0c53 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:41.147657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e64de-0b78-47e3-9d5d-7442f0dc0c53 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:41.147766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e64de-0b78-47e3-9d5d-7442f0dc0c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:41.223416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-032e64de-0b78-47e3-9d5d-7442f0dc0c53 None None] MFA Rules not processed for user `71a15ac6f0154871b851e8c126489c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:41.224626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-032e64de-0b78-47e3-9d5d-7442f0dc0c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:41.293132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:41.327104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 678/1330] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:41.608206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094dbdd-0a80-4683-a54a-085d0538ba70 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:41.612576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b094dbdd-0a80-4683-a54a-085d0538ba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:41.740283 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094dbdd-0a80-4683-a54a-085d0538ba70 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:41.761130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:41.815082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f93bf-bbc0-44c3-a19b-5653a05fb76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:41.815693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f93bf-bbc0-44c3-a19b-5653a05fb76a service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:41.816103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f93bf-bbc0-44c3-a19b-5653a05fb76a service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:41.816375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f93bf-bbc0-44c3-a19b-5653a05fb76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:41.818009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c04f93bf-bbc0-44c3-a19b-5653a05fb76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:41.928993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f93bf-bbc0-44c3-a19b-5653a05fb76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:41.930400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f93bf-bbc0-44c3-a19b-5653a05fb76a service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:41.951543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 653/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:44.219124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e490f2-00b7-4e75-b443-6c5399b9c3a2 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:44.219696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e490f2-00b7-4e75-b443-6c5399b9c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:44.219696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e490f2-00b7-4e75-b443-6c5399b9c3a2 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:44.221085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 679/1332] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:44.226886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90398a0-25fc-4000-bd9a-ed06879cd138 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:44.227465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90398a0-25fc-4000-bd9a-ed06879cd138 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:44.227465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90398a0-25fc-4000-bd9a-ed06879cd138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:44.302323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:44.308217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c90398a0-25fc-4000-bd9a-ed06879cd138 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:44.309720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c90398a0-25fc-4000-bd9a-ed06879cd138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:44.414954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 654/1333] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:44.693029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e490f2-00b7-4e75-b443-6c5399b9c3a2 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:44.694599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-42e490f2-00b7-4e75-b443-6c5399b9c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:44.800315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e490f2-00b7-4e75-b443-6c5399b9c3a2 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:44.874253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b98b42-123a-4df5-afe5-d5f7c2b4cdfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:44.874798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b98b42-123a-4df5-afe5-d5f7c2b4cdfd service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:44.875080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b98b42-123a-4df5-afe5-d5f7c2b4cdfd service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:44.875351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b98b42-123a-4df5-afe5-d5f7c2b4cdfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:44.876961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e0b98b42-123a-4df5-afe5-d5f7c2b4cdfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:44.904327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:44.987727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b98b42-123a-4df5-afe5-d5f7c2b4cdfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:44.989155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b98b42-123a-4df5-afe5-d5f7c2b4cdfd service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:45.007867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 680/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:46.994982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df134a85-b9c2-478d-8d56-c67c3005ac85 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:46.995525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df134a85-b9c2-478d-8d56-c67c3005ac85 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:46.995525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df134a85-b9c2-478d-8d56-c67c3005ac85 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:46.996896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 655/1335] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:39:47.002137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6586d-4a9b-4f97-88de-a44f9976ed14 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:47.002590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6586d-4a9b-4f97-88de-a44f9976ed14 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:47.002686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6586d-4a9b-4f97-88de-a44f9976ed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:47.069058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0bb6586d-4a9b-4f97-88de-a44f9976ed14 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:47.070395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0bb6586d-4a9b-4f97-88de-a44f9976ed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:47.151750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:47.175998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 681/1336] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:47.464627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df134a85-b9c2-478d-8d56-c67c3005ac85 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:47.466157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-df134a85-b9c2-478d-8d56-c67c3005ac85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:47.568566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df134a85-b9c2-478d-8d56-c67c3005ac85 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:47.597719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:47.645903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5ef97-1c26-41d2-a601-abceebaaa25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:47.646511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5ef97-1c26-41d2-a601-abceebaaa25c service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:47.646817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5ef97-1c26-41d2-a601-abceebaaa25c service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:47.647094 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5ef97-1c26-41d2-a601-abceebaaa25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:47.648699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b0f5ef97-1c26-41d2-a601-abceebaaa25c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:47.759500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5ef97-1c26-41d2-a601-abceebaaa25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:47.760998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5ef97-1c26-41d2-a601-abceebaaa25c service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:47.779163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 656/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:50.041462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac7d6-edec-4ddb-88e8-a993801c73af None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:50.042161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac7d6-edec-4ddb-88e8-a993801c73af None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:50.042161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac7d6-edec-4ddb-88e8-a993801c73af None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:50.043405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 682/1338] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:50.049237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174f01f-42e4-469b-a51a-9554ebb3b518 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:50.049785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174f01f-42e4-469b-a51a-9554ebb3b518 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:50.049785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174f01f-42e4-469b-a51a-9554ebb3b518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:50.124188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0174f01f-42e4-469b-a51a-9554ebb3b518 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:50.125449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0174f01f-42e4-469b-a51a-9554ebb3b518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:50.135231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:50.231537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 657/1339] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:50.521998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac7d6-edec-4ddb-88e8-a993801c73af None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:50.523603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-745ac7d6-edec-4ddb-88e8-a993801c73af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:50.636594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac7d6-edec-4ddb-88e8-a993801c73af None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:50.729092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2147-cec4-4ceb-bb28-c52f8bc27507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:50.729710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2147-cec4-4ceb-bb28-c52f8bc27507 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:50.729984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2147-cec4-4ceb-bb28-c52f8bc27507 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:50.730252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2147-cec4-4ceb-bb28-c52f8bc27507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:50.731916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6e1e2147-cec4-4ceb-bb28-c52f8bc27507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:50.771456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:50.851653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e2147-cec4-4ceb-bb28-c52f8bc27507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:50.853104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e2147-cec4-4ceb-bb28-c52f8bc27507 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:50.873177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 683/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:54.741768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e507-6a7a-4117-bdde-288975b491fc None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:54.742273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e507-6a7a-4117-bdde-288975b491fc None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:54.742395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e507-6a7a-4117-bdde-288975b491fc None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:54.743707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 658/1341] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:54.749584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a86b8-96da-4418-bb1f-d068ada272b9 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:54.750028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a86b8-96da-4418-bb1f-d068ada272b9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:54.750304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a86b8-96da-4418-bb1f-d068ada272b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:54.818623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-6c5a86b8-96da-4418-bb1f-d068ada272b9 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:54.819871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6c5a86b8-96da-4418-bb1f-d068ada272b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:54.910804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:54.923348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 684/1342] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:55.210253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e507-6a7a-4117-bdde-288975b491fc None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:55.211833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5e95e507-6a7a-4117-bdde-288975b491fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:55.322625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e507-6a7a-4117-bdde-288975b491fc None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:55.362430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:55.400346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecaac4-9fc1-4f1d-9b29-9d68f3fb8ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:55.400956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecaac4-9fc1-4f1d-9b29-9d68f3fb8ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:55.401235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecaac4-9fc1-4f1d-9b29-9d68f3fb8ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:55.401507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecaac4-9fc1-4f1d-9b29-9d68f3fb8ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:55.403130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d0ecaac4-9fc1-4f1d-9b29-9d68f3fb8ec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:55.513822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecaac4-9fc1-4f1d-9b29-9d68f3fb8ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:55.515366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecaac4-9fc1-4f1d-9b29-9d68f3fb8ec7 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:55.534838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 659/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:39:58.447985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ed727-2f40-4127-8905-5f42173c0c5a None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:58.448549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ed727-2f40-4127-8905-5f42173c0c5a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:58.448549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ed727-2f40-4127-8905-5f42173c0c5a None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:58.449872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 685/1344] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:39:58.455280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed146f8-c910-41f4-ae58-67f0b446db1c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:58.455711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed146f8-c910-41f4-ae58-67f0b446db1c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:58.455832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed146f8-c910-41f4-ae58-67f0b446db1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:58.523982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1ed146f8-c910-41f4-ae58-67f0b446db1c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:39:58.525868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1ed146f8-c910-41f4-ae58-67f0b446db1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:58.544927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:58.636409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 660/1345] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:39:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:39:58.933387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ed727-2f40-4127-8905-5f42173c0c5a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:39:58.935045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7d6ed727-2f40-4127-8905-5f42173c0c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:59.045339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ed727-2f40-4127-8905-5f42173c0c5a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:39:59.139901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be3df8-ce96-42fa-87e9-b33fba8a5563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:39:59.140525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be3df8-ce96-42fa-87e9-b33fba8a5563 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:39:59.140766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be3df8-ce96-42fa-87e9-b33fba8a5563 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:39:59.141037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be3df8-ce96-42fa-87e9-b33fba8a5563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:39:59.143628 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c7be3df8-ce96-42fa-87e9-b33fba8a5563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:39:59.199832 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:39:59.269606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be3df8-ce96-42fa-87e9-b33fba8a5563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:39:59.271084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be3df8-ce96-42fa-87e9-b33fba8a5563 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:39:59.291937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 686/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:39:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:03.488963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744c80-9af9-4feb-a5c0-2c4da56d63fa None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:03.489518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744c80-9af9-4feb-a5c0-2c4da56d63fa None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:03.489518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744c80-9af9-4feb-a5c0-2c4da56d63fa None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:03.490906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 661/1347] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:03.496613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756fc8f-bd6b-42df-9c15-cab10449c0b3 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:03.497109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756fc8f-bd6b-42df-9c15-cab10449c0b3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:03.497200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756fc8f-bd6b-42df-9c15-cab10449c0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:03.571590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e756fc8f-bd6b-42df-9c15-cab10449c0b3 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:03.573128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e756fc8f-bd6b-42df-9c15-cab10449c0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:03.696945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:03.700199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 687/1348] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:03.986935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744c80-9af9-4feb-a5c0-2c4da56d63fa None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:03.988478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-35744c80-9af9-4feb-a5c0-2c4da56d63fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:04.094521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744c80-9af9-4feb-a5c0-2c4da56d63fa None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:04.142287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:04.168924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30978-d336-4507-ba34-7eead906c0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:04.169529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30978-d336-4507-ba34-7eead906c0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:04.169809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30978-d336-4507-ba34-7eead906c0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:04.170083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30978-d336-4507-ba34-7eead906c0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:04.171722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d4f30978-d336-4507-ba34-7eead906c0f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:04.280112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30978-d336-4507-ba34-7eead906c0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:04.281583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30978-d336-4507-ba34-7eead906c0f6 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:04.300415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 662/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:09.218974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f4645-5ef5-4a01-8ce9-11792dadaaff None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:09.219953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f4645-5ef5-4a01-8ce9-11792dadaaff None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:09.220571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f4645-5ef5-4a01-8ce9-11792dadaaff None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:09.222399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 688/1350] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:09.233143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52924886-e00d-49fb-aeb6-b02027571979 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:09.233143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52924886-e00d-49fb-aeb6-b02027571979 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:09.233143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52924886-e00d-49fb-aeb6-b02027571979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:09.363993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-52924886-e00d-49fb-aeb6-b02027571979 None None] MFA Rules not processed for user `be696635db224e3a868957eb5b5bae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:09.365547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-52924886-e00d-49fb-aeb6-b02027571979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:09.390520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:09.523926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 663/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:40:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:13.792307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a182d9-359f-4b5b-b580-b77ed8132f84 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:13.793229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a182d9-359f-4b5b-b580-b77ed8132f84 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:13.793547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a182d9-359f-4b5b-b580-b77ed8132f84 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:13.795397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 689/1352] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:40:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:13.800179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74997a-c090-45da-878d-08eea0c75f0c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:13.800597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74997a-c090-45da-878d-08eea0c75f0c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:13.800912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74997a-c090-45da-878d-08eea0c75f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:13.885811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0f74997a-c090-45da-878d-08eea0c75f0c None None] MFA Rules not processed for user `be696635db224e3a868957eb5b5bae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:13.887012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0f74997a-c090-45da-878d-08eea0c75f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:13.964324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:14.004925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 664/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:40:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:15.521623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48333c7a-4053-433f-b652-f11807c3e7f3 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:15.522197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48333c7a-4053-433f-b652-f11807c3e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:15.522197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48333c7a-4053-433f-b652-f11807c3e7f3 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:15.523601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 690/1354] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:15.529454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f2c8e-787a-4ca2-a15b-ae0d362b04cc None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:15.529931 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f2c8e-787a-4ca2-a15b-ae0d362b04cc None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:15.530050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f2c8e-787a-4ca2-a15b-ae0d362b04cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:15.610246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e59f2c8e-787a-4ca2-a15b-ae0d362b04cc None None] MFA Rules not processed for user `be696635db224e3a868957eb5b5bae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:15.612274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e59f2c8e-787a-4ca2-a15b-ae0d362b04cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:15.722406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 665/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:40:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:19.162580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c24f74-d945-4c58-a320-f635fe80ead4 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:19.163021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c24f74-d945-4c58-a320-f635fe80ead4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:19.163021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c24f74-d945-4c58-a320-f635fe80ead4 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:19.164357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 691/1356] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:19.170414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a0a8-40c3-4bfc-953b-d8908bee8ad9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:19.170906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a0a8-40c3-4bfc-953b-d8908bee8ad9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:19.170906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a0a8-40c3-4bfc-953b-d8908bee8ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:19.207908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:19.246060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-29b5a0a8-40c3-4bfc-953b-d8908bee8ad9 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:19.247326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-29b5a0a8-40c3-4bfc-953b-d8908bee8ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:19.380661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 666/1357] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:19.711826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174d79e-8c5d-436d-9688-0b05a517d557 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:19.713670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174d79e-8c5d-436d-9688-0b05a517d557 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:19.714481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174d79e-8c5d-436d-9688-0b05a517d557 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:19.716975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 692/1358] 10.222.0.65 () {54 vars in 962 bytes} [Thu Aug 18 20:40:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:19.725394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e6a39-3543-4e16-a339-0933e67aec07 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:19.725783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e6a39-3543-4e16-a339-0933e67aec07 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:19.725967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e6a39-3543-4e16-a339-0933e67aec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:19.818976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-603e6a39-3543-4e16-a339-0933e67aec07 None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:19.820092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-603e6a39-3543-4e16-a339-0933e67aec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:19.873784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:19.955197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 667/1359] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Aug 18 20:40:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:19.963852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174d79e-8c5d-436d-9688-0b05a517d557 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:19.965456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e174d79e-8c5d-436d-9688-0b05a517d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:20.130056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174d79e-8c5d-436d-9688-0b05a517d557 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:20.208862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:20.252052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a266745-02ac-4b3d-b25d-e9a3fe956a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:20.252660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a266745-02ac-4b3d-b25d-e9a3fe956a25 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:20.252937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a266745-02ac-4b3d-b25d-e9a3fe956a25 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:20.253209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a266745-02ac-4b3d-b25d-e9a3fe956a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:20.254846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6a266745-02ac-4b3d-b25d-e9a3fe956a25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:20.347107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a266745-02ac-4b3d-b25d-e9a3fe956a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:20.348708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a266745-02ac-4b3d-b25d-e9a3fe956a25 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:20.367702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 693/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:22.507038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c27f16-190e-4ad7-a4bf-ccea406ed014 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:22.507573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c27f16-190e-4ad7-a4bf-ccea406ed014 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:22.507573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c27f16-190e-4ad7-a4bf-ccea406ed014 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:22.509390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 668/1361] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:22.514341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea84e-da08-4451-873b-abab11ed0036 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:22.514829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea84e-da08-4451-873b-abab11ed0036 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:22.514942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea84e-da08-4451-873b-abab11ed0036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:22.611920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1b1ea84e-da08-4451-873b-abab11ed0036 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:22.613229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1b1ea84e-da08-4451-873b-abab11ed0036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:22.657777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:22.734851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 694/1362] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:23.055190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c27f16-190e-4ad7-a4bf-ccea406ed014 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:23.057311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-80c27f16-190e-4ad7-a4bf-ccea406ed014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:23.224882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c27f16-190e-4ad7-a4bf-ccea406ed014 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:23.235179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:23.354470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175e0f-fa0e-4d38-a08c-f74126b66863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:23.355208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175e0f-fa0e-4d38-a08c-f74126b66863 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:23.355553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175e0f-fa0e-4d38-a08c-f74126b66863 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:23.355923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175e0f-fa0e-4d38-a08c-f74126b66863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:23.357618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c1175e0f-fa0e-4d38-a08c-f74126b66863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:23.473738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175e0f-fa0e-4d38-a08c-f74126b66863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:23.476165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175e0f-fa0e-4d38-a08c-f74126b66863 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:23.502308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 669/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:25.739448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41673ee-766d-4fda-8907-ac28d0a48088 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:25.740000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41673ee-766d-4fda-8907-ac28d0a48088 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:25.740000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41673ee-766d-4fda-8907-ac28d0a48088 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:25.741340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 695/1364] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:25.747289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b83a4e-c63d-45bb-b5b8-f9c21ab3fbc7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:25.747747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b83a4e-c63d-45bb-b5b8-f9c21ab3fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:25.747831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b83a4e-c63d-45bb-b5b8-f9c21ab3fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:25.768768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:25.833218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a2b83a4e-c63d-45bb-b5b8-f9c21ab3fbc7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:25.834461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a2b83a4e-c63d-45bb-b5b8-f9c21ab3fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:25.961243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 670/1365] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:26.252866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69be0ee-23f8-4e96-9c24-93970c798381 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:26.253206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69be0ee-23f8-4e96-9c24-93970c798381 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:26.253548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69be0ee-23f8-4e96-9c24-93970c798381 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:26.255077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 696/1366] 10.222.0.65 () {54 vars in 962 bytes} [Thu Aug 18 20:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:26.265063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488a84-5b3b-4e34-8bc4-ce5669a3e7bd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:26.265591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488a84-5b3b-4e34-8bc4-ce5669a3e7bd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:26.265870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488a84-5b3b-4e34-8bc4-ce5669a3e7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:26.355688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a7488a84-5b3b-4e34-8bc4-ce5669a3e7bd None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:26.356938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a7488a84-5b3b-4e34-8bc4-ce5669a3e7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:26.395975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:26.495087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 671/1367] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Aug 18 20:40:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:26.495813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69be0ee-23f8-4e96-9c24-93970c798381 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:26.497511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f69be0ee-23f8-4e96-9c24-93970c798381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:26.662308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69be0ee-23f8-4e96-9c24-93970c798381 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:26.685695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:26.797484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fcc1b-7f8d-4a32-95cd-7093a42b4940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:26.798179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fcc1b-7f8d-4a32-95cd-7093a42b4940 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:26.798572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fcc1b-7f8d-4a32-95cd-7093a42b4940 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:26.798980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fcc1b-7f8d-4a32-95cd-7093a42b4940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:26.800873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a57fcc1b-7f8d-4a32-95cd-7093a42b4940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:26.903427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fcc1b-7f8d-4a32-95cd-7093a42b4940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:26.905049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fcc1b-7f8d-4a32-95cd-7093a42b4940 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:26.925093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 697/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:27.608907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0906a-be18-4988-8748-6a869a6f6246 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:27.609475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0906a-be18-4988-8748-6a869a6f6246 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:27.609475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0906a-be18-4988-8748-6a869a6f6246 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:27.610987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 672/1369] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:27.616272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aa1ce-2c0a-49aa-99b9-53e86075c40f None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:27.616567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aa1ce-2c0a-49aa-99b9-53e86075c40f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:27.616844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aa1ce-2c0a-49aa-99b9-53e86075c40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:27.649827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:27.687856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-248aa1ce-2c0a-49aa-99b9-53e86075c40f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:27.689186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-248aa1ce-2c0a-49aa-99b9-53e86075c40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:27.801774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 698/1370] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:28.419333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239eaea-39ab-44e2-96fc-a1d21848604a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:28.419587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239eaea-39ab-44e2-96fc-a1d21848604a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:28.419809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239eaea-39ab-44e2-96fc-a1d21848604a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:28.421556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 673/1371] 10.222.0.65 () {54 vars in 964 bytes} [Thu Aug 18 20:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:28.426653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc26f3-3c65-4e98-ae5f-d5932a2e9c89 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:28.426976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc26f3-3c65-4e98-ae5f-d5932a2e9c89 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:28.427254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc26f3-3c65-4e98-ae5f-d5932a2e9c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:28.522531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-21cc26f3-3c65-4e98-ae5f-d5932a2e9c89 None None] MFA Rules not processed for user `3da4ea5ad2924cf4baef5614929b7e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:28.524044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-21cc26f3-3c65-4e98-ae5f-d5932a2e9c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:28.580131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:28.620713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 699/1372] 10.222.0.65 () {58 vars in 1061 bytes} [Thu Aug 18 20:40:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:28.628167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239eaea-39ab-44e2-96fc-a1d21848604a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:28.629919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e239eaea-39ab-44e2-96fc-a1d21848604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:28.742747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239eaea-39ab-44e2-96fc-a1d21848604a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:28.789516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:28.832276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:28.832768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:28.833097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:28.833460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:28.835230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:28.967721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113dba-c09a-4a2e-b1d7-bcdbd10a34ae None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:28.968339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113dba-c09a-4a2e-b1d7-bcdbd10a34ae None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:28.968339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113dba-c09a-4a2e-b1d7-bcdbd10a34ae None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:28.969493 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:28.969878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 700/1373] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:28.971066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:28.974756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c6465-06e3-447a-9388-aafe79a123b7 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:28.975120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c6465-06e3-447a-9388-aafe79a123b7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:28.975436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c6465-06e3-447a-9388-aafe79a123b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:28.995210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 674/1374] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:29.056599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-fc3c6465-06e3-447a-9388-aafe79a123b7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:29.057509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-fc3c6465-06e3-447a-9388-aafe79a123b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:29.177345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 701/1375] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:29.491075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:29.492855 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:29.580719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:29.620205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0e0a-f40e-4551-92cf-d059c76eca02 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:29.740356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9d7eb-a1cf-4a3b-83d4-cfd7e9428058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:29.741104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9d7eb-a1cf-4a3b-83d4-cfd7e9428058 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:29.741104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9d7eb-a1cf-4a3b-83d4-cfd7e9428058 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:29.741372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9d7eb-a1cf-4a3b-83d4-cfd7e9428058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:29.743044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-dce9d7eb-a1cf-4a3b-83d4-cfd7e9428058 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:29.846973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:29.872891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9d7eb-a1cf-4a3b-83d4-cfd7e9428058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:29.874633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9d7eb-a1cf-4a3b-83d4-cfd7e9428058 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:29.895774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 675/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:31.855408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8d1d-f4e0-463f-bbe7-ab2ee3387333 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:31.856299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8d1d-f4e0-463f-bbe7-ab2ee3387333 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:31.856566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8d1d-f4e0-463f-bbe7-ab2ee3387333 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:31.858398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 702/1377] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:31.865368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62cc90-7640-4ce8-8128-330ee7874607 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:31.865852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62cc90-7640-4ce8-8128-330ee7874607 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:31.865940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62cc90-7640-4ce8-8128-330ee7874607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:31.948278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8a62cc90-7640-4ce8-8128-330ee7874607 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:31.949511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8a62cc90-7640-4ce8-8128-330ee7874607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:32.050244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 676/1378] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:32.356332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8d1d-f4e0-463f-bbe7-ab2ee3387333 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:32.358036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-603e8d1d-f4e0-463f-bbe7-ab2ee3387333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:32.413235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:32.510194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8d1d-f4e0-463f-bbe7-ab2ee3387333 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:32.635157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9760c-a6e7-41f6-928a-343671cb5652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:32.635775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9760c-a6e7-41f6-928a-343671cb5652 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:32.636060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9760c-a6e7-41f6-928a-343671cb5652 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:32.636336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9760c-a6e7-41f6-928a-343671cb5652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:32.637981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3ac9760c-a6e7-41f6-928a-343671cb5652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:32.651200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:32.746968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9760c-a6e7-41f6-928a-343671cb5652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:32.748580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9760c-a6e7-41f6-928a-343671cb5652 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:32.785082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 703/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:34.784545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8f7b3-a5a5-4c79-ad90-301ae926abd9 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:34.785057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8f7b3-a5a5-4c79-ad90-301ae926abd9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:34.785057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8f7b3-a5a5-4c79-ad90-301ae926abd9 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:34.786490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 677/1380] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:34.792342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2f23d-b51b-42a8-a4b0-fc147adb0fe2 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:34.792850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2f23d-b51b-42a8-a4b0-fc147adb0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:34.792940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2f23d-b51b-42a8-a4b0-fc147adb0fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:34.865665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-65f2f23d-b51b-42a8-a4b0-fc147adb0fe2 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:34.866929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-65f2f23d-b51b-42a8-a4b0-fc147adb0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:34.970169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:34.985071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 704/1381] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:40:35.280311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8f7b3-a5a5-4c79-ad90-301ae926abd9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:35.281833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5dd8f7b3-a5a5-4c79-ad90-301ae926abd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:35.365835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:35.458612 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8f7b3-a5a5-4c79-ad90-301ae926abd9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:35.600472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c7ea1-1ce0-4980-b712-b4e5d6cdd295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:35.601090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c7ea1-1ce0-4980-b712-b4e5d6cdd295 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:35.601506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c7ea1-1ce0-4980-b712-b4e5d6cdd295 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:35.601788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c7ea1-1ce0-4980-b712-b4e5d6cdd295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:35.603515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-640c7ea1-1ce0-4980-b712-b4e5d6cdd295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:35.631112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:35.718216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c7ea1-1ce0-4980-b712-b4e5d6cdd295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:35.719919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c7ea1-1ce0-4980-b712-b4e5d6cdd295 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:35.742737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 678/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:37.711410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9667-9715-47b2-9205-9f448f044c9b None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:37.712365 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9667-9715-47b2-9205-9f448f044c9b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:37.712365 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9667-9715-47b2-9205-9f448f044c9b None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:37.713400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 705/1383] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:37.718789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9bbe-95fa-436f-9d13-71ccc087bd08 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:37.719390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9bbe-95fa-436f-9d13-71ccc087bd08 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:37.719390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9bbe-95fa-436f-9d13-71ccc087bd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:37.792467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-547a9bbe-95fa-436f-9d13-71ccc087bd08 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:37.793748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-547a9bbe-95fa-436f-9d13-71ccc087bd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:37.904635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:37.908416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 679/1384] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:38.196841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9667-9715-47b2-9205-9f448f044c9b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:38.198492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-fcac9667-9715-47b2-9205-9f448f044c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:38.353787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9667-9715-47b2-9205-9f448f044c9b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:38.426859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:38.499625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bc614-a29e-4575-ac25-acedc46a1320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:38.500163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bc614-a29e-4575-ac25-acedc46a1320 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:38.500444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bc614-a29e-4575-ac25-acedc46a1320 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:38.500730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bc614-a29e-4575-ac25-acedc46a1320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:38.502377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-366bc614-a29e-4575-ac25-acedc46a1320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:38.610355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bc614-a29e-4575-ac25-acedc46a1320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:38.612015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bc614-a29e-4575-ac25-acedc46a1320 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:38.630821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 706/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:40.551423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e9944-aa85-4289-966c-61004ec79eb1 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:40.552009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e9944-aa85-4289-966c-61004ec79eb1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:40.552111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e9944-aa85-4289-966c-61004ec79eb1 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:40.554090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 680/1386] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:40.559290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96e6f-ef90-4ede-840f-0408211f877b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:40.559757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96e6f-ef90-4ede-840f-0408211f877b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:40.559871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96e6f-ef90-4ede-840f-0408211f877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:40.631465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-11b96e6f-ef90-4ede-840f-0408211f877b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:40.632683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-11b96e6f-ef90-4ede-840f-0408211f877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:40.670372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:40.751429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 707/1387] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:41.125273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e9944-aa85-4289-966c-61004ec79eb1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:41.127129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ce6e9944-aa85-4289-966c-61004ec79eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:41.295001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e9944-aa85-4289-966c-61004ec79eb1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:41.380833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:41.432806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d3b43-11c6-4cfb-b661-5f127068bdae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:41.433426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d3b43-11c6-4cfb-b661-5f127068bdae service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:41.433707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d3b43-11c6-4cfb-b661-5f127068bdae service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:41.433981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d3b43-11c6-4cfb-b661-5f127068bdae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:41.435630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ef0d3b43-11c6-4cfb-b661-5f127068bdae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:41.531599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d3b43-11c6-4cfb-b661-5f127068bdae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:41.533213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d3b43-11c6-4cfb-b661-5f127068bdae service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:41.552540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 681/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:43.856924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa14e6-80a4-4e2a-801a-72453918a8eb None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:43.857524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa14e6-80a4-4e2a-801a-72453918a8eb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:43.857524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa14e6-80a4-4e2a-801a-72453918a8eb None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:43.858739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 708/1389] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:43.864079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8c85d-e217-4ba0-ae31-e6f4746516fd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:43.864495 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8c85d-e217-4ba0-ae31-e6f4746516fd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:43.864662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8c85d-e217-4ba0-ae31-e6f4746516fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:43.934572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-40d8c85d-e217-4ba0-ae31-e6f4746516fd None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:43.935795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-40d8c85d-e217-4ba0-ae31-e6f4746516fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:43.973602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:44.038867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 682/1390] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:44.330757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa14e6-80a4-4e2a-801a-72453918a8eb None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:44.332371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7afa14e6-80a4-4e2a-801a-72453918a8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:44.485857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa14e6-80a4-4e2a-801a-72453918a8eb None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:44.495382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:44.565346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40464ee0-db7e-4959-b415-d0d7164b4728 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:44.565695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40464ee0-db7e-4959-b415-d0d7164b4728 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:44.565889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40464ee0-db7e-4959-b415-d0d7164b4728 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:44.567461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 683/1391] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:40:44.572670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a96b9-7deb-4c70-aa11-ea1e71c60265 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:44.572949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a96b9-7deb-4c70-aa11-ea1e71c60265 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:44.573223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a96b9-7deb-4c70-aa11-ea1e71c60265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:44.608608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e188e-e9dd-4594-a7ae-d5cca638ed83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:44.609218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e188e-e9dd-4594-a7ae-d5cca638ed83 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:44.609494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e188e-e9dd-4594-a7ae-d5cca638ed83 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:44.609766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e188e-e9dd-4594-a7ae-d5cca638ed83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:44.611403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-936e188e-e9dd-4594-a7ae-d5cca638ed83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:44.655233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b87a96b9-7deb-4c70-aa11-ea1e71c60265 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:44.656465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b87a96b9-7deb-4c70-aa11-ea1e71c60265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:44.713302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e188e-e9dd-4594-a7ae-d5cca638ed83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:44.714951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e188e-e9dd-4594-a7ae-d5cca638ed83 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:44.734147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 709/1392] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:44.763594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 684/1393] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:40:45.062562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53472f4-a40c-49dc-aa8b-26ebeacf5cd7 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:45.063082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53472f4-a40c-49dc-aa8b-26ebeacf5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:45.063283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53472f4-a40c-49dc-aa8b-26ebeacf5cd7 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:45.064482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 710/1394] 10.222.0.65 () {54 vars in 967 bytes} [Thu Aug 18 20:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:45.069559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a949-22c5-44ba-a733-d16a525160fe None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:45.070014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a949-22c5-44ba-a733-d16a525160fe None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:45.070108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a949-22c5-44ba-a733-d16a525160fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:45.092416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:45.153007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6250a949-22c5-44ba-a733-d16a525160fe None None] MFA Rules not processed for user `0d4e9baa7a6241b1807c67844c7d424c`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:45.154287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6250a949-22c5-44ba-a733-d16a525160fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:45.235200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 685/1395] 10.222.0.65 () {58 vars in 1064 bytes} [Thu Aug 18 20:40:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:45.242624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53472f4-a40c-49dc-aa8b-26ebeacf5cd7 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:45.244263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b53472f4-a40c-49dc-aa8b-26ebeacf5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:45.258078 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:45.351247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53472f4-a40c-49dc-aa8b-26ebeacf5cd7 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:45.427435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028f73e-ef25-4f83-be4f-7cb01c1722cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d4e9baa7a6241b1807c67844c7d424c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:45.428046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f73e-ef25-4f83-be4f-7cb01c1722cf service glance] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:45.428319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f73e-ef25-4f83-be4f-7cb01c1722cf service glance] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:45.428584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f73e-ef25-4f83-be4f-7cb01c1722cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:45.430235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a028f73e-ef25-4f83-be4f-7cb01c1722cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:45.506548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:45.550114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028f73e-ef25-4f83-be4f-7cb01c1722cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:45.551577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028f73e-ef25-4f83-be4f-7cb01c1722cf service glance] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:45.574356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 711/1396] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:46.354737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65da4-e171-46b8-9a72-f9df5fb4d13a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:46.355309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65da4-e171-46b8-9a72-f9df5fb4d13a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:46.355309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65da4-e171-46b8-9a72-f9df5fb4d13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:46.437774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-99c65da4-e171-46b8-9a72-f9df5fb4d13a None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:46.439352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-99c65da4-e171-46b8-9a72-f9df5fb4d13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:46.503904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:46.542041 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 686/1397] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:40:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:40:46.588461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907638e6-9bae-41da-9b3c-9bb7940ad66f None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:46.589817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907638e6-9bae-41da-9b3c-9bb7940ad66f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:46.590243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907638e6-9bae-41da-9b3c-9bb7940ad66f None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:46.592276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 712/1398] 10.222.0.65 () {54 vars in 943 bytes} [Thu Aug 18 20:40:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:46.601611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38580d0c-93b3-4deb-af84-540aca2ee67e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:46.601928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38580d0c-93b3-4deb-af84-540aca2ee67e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:46.602209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38580d0c-93b3-4deb-af84-540aca2ee67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:46.685115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-38580d0c-93b3-4deb-af84-540aca2ee67e None None] MFA Rules not processed for user `7345509ac3604cf99c0e9ef232afcd09`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:46.686345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-38580d0c-93b3-4deb-af84-540aca2ee67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:46.755579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7273e-6686-4c2d-a26e-2d3c3ab8f9d1 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:46.755887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7273e-6686-4c2d-a26e-2d3c3ab8f9d1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:46.756164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7273e-6686-4c2d-a26e-2d3c3ab8f9d1 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:46.757523 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 713/1399] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:40:46.763275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf4abd-2a86-4e6d-a829-bfa5be6dba91 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:46.763614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf4abd-2a86-4e6d-a829-bfa5be6dba91 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:46.763830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf4abd-2a86-4e6d-a829-bfa5be6dba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:46.798461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 687/1400] 10.222.0.65 () {58 vars in 1040 bytes} [Thu Aug 18 20:40:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:46.808148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38580d0c-93b3-4deb-af84-540aca2ee67e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:46.817799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38580d0c-93b3-4deb-af84-540aca2ee67e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:46.833057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-83cf4abd-2a86-4e6d-a829-bfa5be6dba91 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:46.834205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-83cf4abd-2a86-4e6d-a829-bfa5be6dba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:46.846174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:46.930418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128a0bc-5f66-42ff-b5ec-6ef6ca28df37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:46.931368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128a0bc-5f66-42ff-b5ec-6ef6ca28df37 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:46.931650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128a0bc-5f66-42ff-b5ec-6ef6ca28df37 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:46.931921 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128a0bc-5f66-42ff-b5ec-6ef6ca28df37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:46.933580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0128a0bc-5f66-42ff-b5ec-6ef6ca28df37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:46.936837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 714/1401] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:40:47.022147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128a0bc-5f66-42ff-b5ec-6ef6ca28df37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:47.023786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128a0bc-5f66-42ff-b5ec-6ef6ca28df37 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:47.032170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 688/1402] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:40:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 20:40:47.233590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf4abd-2a86-4e6d-a829-bfa5be6dba91 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:47.234847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-83cf4abd-2a86-4e6d-a829-bfa5be6dba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:47.264065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:47.370053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf4abd-2a86-4e6d-a829-bfa5be6dba91 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:47.510525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea74ba6-22a4-4f87-a829-8644cd01085a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:47.511170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea74ba6-22a4-4f87-a829-8644cd01085a service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:47.511445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea74ba6-22a4-4f87-a829-8644cd01085a service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:47.511713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea74ba6-22a4-4f87-a829-8644cd01085a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:47.513336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7ea74ba6-22a4-4f87-a829-8644cd01085a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:47.533658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:47.639563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea74ba6-22a4-4f87-a829-8644cd01085a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:47.641199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea74ba6-22a4-4f87-a829-8644cd01085a service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:47.662440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 715/1403] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:49.703979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d686f-794c-45a7-9f78-9b15d9e3a065 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:49.704888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d686f-794c-45a7-9f78-9b15d9e3a065 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:49.704888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d686f-794c-45a7-9f78-9b15d9e3a065 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:49.710924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 689/1404] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:49.715258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c62e4-bcf0-431f-8126-8e4005489a9a None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:49.715750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c62e4-bcf0-431f-8126-8e4005489a9a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:49.716082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c62e4-bcf0-431f-8126-8e4005489a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:49.788601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-dc5c62e4-bcf0-431f-8126-8e4005489a9a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:49.790412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-dc5c62e4-bcf0-431f-8126-8e4005489a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:49.899977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:49.907774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 716/1405] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:50.198561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d686f-794c-45a7-9f78-9b15d9e3a065 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:50.200125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-821d686f-794c-45a7-9f78-9b15d9e3a065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:50.321961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:50.445317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d686f-794c-45a7-9f78-9b15d9e3a065 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:50.577930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767adda-98d9-464e-a693-cb37ecbd0dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:50.578544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767adda-98d9-464e-a693-cb37ecbd0dac service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:50.578850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767adda-98d9-464e-a693-cb37ecbd0dac service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:50.579127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767adda-98d9-464e-a693-cb37ecbd0dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:50.580767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5767adda-98d9-464e-a693-cb37ecbd0dac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:50.610507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:50.694817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767adda-98d9-464e-a693-cb37ecbd0dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:50.697320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767adda-98d9-464e-a693-cb37ecbd0dac service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:50.718455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 690/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:40:52.791559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf197bd-f55c-4e08-b111-ea05c0573be5 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:52.792316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf197bd-f55c-4e08-b111-ea05c0573be5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:52.792316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf197bd-f55c-4e08-b111-ea05c0573be5 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:52.794712 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 717/1407] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:40:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:40:52.803224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5365ae-5d7b-4a5b-a3ca-781e7cf82f69 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:52.803733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5365ae-5d7b-4a5b-a3ca-781e7cf82f69 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:52.804001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5365ae-5d7b-4a5b-a3ca-781e7cf82f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:52.882215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9b5365ae-5d7b-4a5b-a3ca-781e7cf82f69 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:40:52.884183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9b5365ae-5d7b-4a5b-a3ca-781e7cf82f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:52.999895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:53.004548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 691/1408] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:40:53.316137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf197bd-f55c-4e08-b111-ea05c0573be5 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:40:53.317646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0bf197bd-f55c-4e08-b111-ea05c0573be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:53.495016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf197bd-f55c-4e08-b111-ea05c0573be5 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:40:53.575730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:40:53.634459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71421606-b8fc-4509-b7fb-9f6cef0beb66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:40:53.635299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71421606-b8fc-4509-b7fb-9f6cef0beb66 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:40:53.635665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71421606-b8fc-4509-b7fb-9f6cef0beb66 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:40:53.636137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71421606-b8fc-4509-b7fb-9f6cef0beb66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:40:53.637966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-71421606-b8fc-4509-b7fb-9f6cef0beb66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:40:53.748104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71421606-b8fc-4509-b7fb-9f6cef0beb66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:40:53.749968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71421606-b8fc-4509-b7fb-9f6cef0beb66 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:40:53.769356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 718/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:03.010057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:03.766757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=64 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:09.516720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec1df9-45b7-4ebc-aad0-807ce59eb1c3 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:09.517262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec1df9-45b7-4ebc-aad0-807ce59eb1c3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:09.517262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec1df9-45b7-4ebc-aad0-807ce59eb1c3 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:09.518524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 692/1410] 10.222.0.65 () {54 vars in 918 bytes} [Thu Aug 18 20:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:09.523861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da87f5-7953-40e9-bd8a-571bfa7d6c01 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:09.524526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da87f5-7953-40e9-bd8a-571bfa7d6c01 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:09.524526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da87f5-7953-40e9-bd8a-571bfa7d6c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:09.605148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-01da87f5-7953-40e9-bd8a-571bfa7d6c01 None None] MFA Rules not processed for user `be696635db224e3a868957eb5b5bae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:09.606392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-01da87f5-7953-40e9-bd8a-571bfa7d6c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:09.716739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 719/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Aug 18 20:41:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:09.731546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10591b1-e0e6-4379-9b14-ffae8226156b None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:09.731838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10591b1-e0e6-4379-9b14-ffae8226156b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:09.732113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10591b1-e0e6-4379-9b14-ffae8226156b None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:09.733442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 693/1412] 10.222.0.65 () {54 vars in 918 bytes} [Thu Aug 18 20:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:09.738340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c708e9-a954-4c7c-b842-2b7ee03b28c1 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:09.738653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c708e9-a954-4c7c-b842-2b7ee03b28c1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:09.738976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c708e9-a954-4c7c-b842-2b7ee03b28c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:09.812013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:09.815164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-65c708e9-a954-4c7c-b842-2b7ee03b28c1 None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:09.816927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-65c708e9-a954-4c7c-b842-2b7ee03b28c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:09.936436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 720/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Aug 18 20:41:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:12.338175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e422f40-2da9-42d3-bf12-b5375c082f03 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:12.338738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e422f40-2da9-42d3-bf12-b5375c082f03 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:12.338738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e422f40-2da9-42d3-bf12-b5375c082f03 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:12.340059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:41:12.345449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def098d-c4de-40a6-97a3-ba2907f84193 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:12.345874 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def098d-c4de-40a6-97a3-ba2907f84193 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:12.345986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def098d-c4de-40a6-97a3-ba2907f84193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:12.413437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-4def098d-c4de-40a6-97a3-ba2907f84193 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:12.414643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4def098d-c4de-40a6-97a3-ba2907f84193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:12.468238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:12.511774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:12.798440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e422f40-2da9-42d3-bf12-b5375c082f03 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:12.800154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3e422f40-2da9-42d3-bf12-b5375c082f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:12.952164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e422f40-2da9-42d3-bf12-b5375c082f03 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:13.026484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:13.066560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fc511-3bf8-4722-8ac9-8f9644e72bac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:13.067193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fc511-3bf8-4722-8ac9-8f9644e72bac service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:13.067466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fc511-3bf8-4722-8ac9-8f9644e72bac service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:13.067758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fc511-3bf8-4722-8ac9-8f9644e72bac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:13.069326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-700fc511-3bf8-4722-8ac9-8f9644e72bac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:13.159443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fc511-3bf8-4722-8ac9-8f9644e72bac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:13.161095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fc511-3bf8-4722-8ac9-8f9644e72bac service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:13.179216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 695/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:14.095441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196d9c-d046-4314-991d-1b9d673a612e None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:14.096014 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196d9c-d046-4314-991d-1b9d673a612e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:14.096014 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196d9c-d046-4314-991d-1b9d673a612e None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:14.097327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:14.103074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d6625-ccef-40ee-9777-544e806ffac8 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:14.103539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d6625-ccef-40ee-9777-544e806ffac8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:14.103650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d6625-ccef-40ee-9777-544e806ffac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:14.182001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-625d6625-ccef-40ee-9777-544e806ffac8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:14.183260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-625d6625-ccef-40ee-9777-544e806ffac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:14.211636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:14.283515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:14.433619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be196d9c-d046-4314-991d-1b9d673a612e None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:14.435185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-be196d9c-d046-4314-991d-1b9d673a612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:14.583642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be196d9c-d046-4314-991d-1b9d673a612e None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:14.627286 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:14.706405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143aa16-592f-4c31-b682-91ff590e1ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:14.706968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143aa16-592f-4c31-b682-91ff590e1ff0 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:14.707359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143aa16-592f-4c31-b682-91ff590e1ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:14.707629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143aa16-592f-4c31-b682-91ff590e1ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:14.710820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0143aa16-592f-4c31-b682-91ff590e1ff0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:14.811756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143aa16-592f-4c31-b682-91ff590e1ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:14.813373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143aa16-592f-4c31-b682-91ff590e1ff0 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:14.831546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 723/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:15.728523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0aadd-d98d-4da6-99c4-d8674702235f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:15.729091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0aadd-d98d-4da6-99c4-d8674702235f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:15.729091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0aadd-d98d-4da6-99c4-d8674702235f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:15.730420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:15.735413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f001bc-64d0-40ab-85eb-d99e7844b4c5 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:15.735820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f001bc-64d0-40ab-85eb-d99e7844b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:15.735956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f001bc-64d0-40ab-85eb-d99e7844b4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:15.793070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:15.815795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-71f001bc-64d0-40ab-85eb-d99e7844b4c5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:15.817033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-71f001bc-64d0-40ab-85eb-d99e7844b4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:15.918073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:16.067387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0aadd-d98d-4da6-99c4-d8674702235f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:16.069271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-61d0aadd-d98d-4da6-99c4-d8674702235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:16.219018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0aadd-d98d-4da6-99c4-d8674702235f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:16.231294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:16.331856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bb02c-5292-4d05-ad20-1a4e532967ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:16.332463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb02c-5292-4d05-ad20-1a4e532967ea service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:16.332742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb02c-5292-4d05-ad20-1a4e532967ea service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:16.333012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb02c-5292-4d05-ad20-1a4e532967ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:16.334616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-dc7bb02c-5292-4d05-ad20-1a4e532967ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:16.425930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bb02c-5292-4d05-ad20-1a4e532967ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:16.427615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bb02c-5292-4d05-ad20-1a4e532967ea service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:16.446952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 698/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:17.334120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763edf-539a-4eb3-b30e-f8e6f0a9f580 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:17.334661 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763edf-539a-4eb3-b30e-f8e6f0a9f580 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:17.334661 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763edf-539a-4eb3-b30e-f8e6f0a9f580 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:17.336208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:17.341267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2768f-3ccb-4025-b6db-f0200f4b503a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:17.341707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2768f-3ccb-4025-b6db-f0200f4b503a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:17.341846 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2768f-3ccb-4025-b6db-f0200f4b503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:17.361646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:17.418936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-30e2768f-3ccb-4025-b6db-f0200f4b503a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:17.420138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-30e2768f-3ccb-4025-b6db-f0200f4b503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:17.518086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:17.669946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e763edf-539a-4eb3-b30e-f8e6f0a9f580 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:17.671501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9e763edf-539a-4eb3-b30e-f8e6f0a9f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:17.782327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:17.819201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e763edf-539a-4eb3-b30e-f8e6f0a9f580 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:17.933979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24e018-ef3f-4a40-81d0-3058c3d63bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:17.934635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24e018-ef3f-4a40-81d0-3058c3d63bea service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:17.935019 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24e018-ef3f-4a40-81d0-3058c3d63bea service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:17.935298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24e018-ef3f-4a40-81d0-3058c3d63bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:17.937836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7d24e018-ef3f-4a40-81d0-3058c3d63bea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:18.026622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:18.042560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24e018-ef3f-4a40-81d0-3058c3d63bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:18.044149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24e018-ef3f-4a40-81d0-3058c3d63bea service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:18.062850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 726/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:18.940684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aafe3-638f-4540-9c68-97cee7b6e319 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:18.941325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aafe3-638f-4540-9c68-97cee7b6e319 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:18.941325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aafe3-638f-4540-9c68-97cee7b6e319 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:18.942603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:18.947917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ac8b3-a9b2-46d9-8ba7-2f7dfc0b1938 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:18.948393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ac8b3-a9b2-46d9-8ba7-2f7dfc0b1938 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:18.948509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ac8b3-a9b2-46d9-8ba7-2f7dfc0b1938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:19.026222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-616ac8b3-a9b2-46d9-8ba7-2f7dfc0b1938 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:19.027461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-616ac8b3-a9b2-46d9-8ba7-2f7dfc0b1938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:19.126045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:19.278412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aafe3-638f-4540-9c68-97cee7b6e319 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:19.279987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-461aafe3-638f-4540-9c68-97cee7b6e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:19.483740 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:19.549967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aafe3-638f-4540-9c68-97cee7b6e319 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:19.664974 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8db1a-6a95-4cbc-8675-5b1e3da2b972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:19.665575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8db1a-6a95-4cbc-8675-5b1e3da2b972 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:19.665848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8db1a-6a95-4cbc-8675-5b1e3da2b972 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:19.666114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8db1a-6a95-4cbc-8675-5b1e3da2b972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:19.667732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-05b8db1a-6a95-4cbc-8675-5b1e3da2b972 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:19.714527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:19.755411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8db1a-6a95-4cbc-8675-5b1e3da2b972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:19.756927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8db1a-6a95-4cbc-8675-5b1e3da2b972 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:19.775659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 701/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:20.602129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1beb03-5b61-437a-9e55-b4bcc82b4190 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:20.602610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1beb03-5b61-437a-9e55-b4bcc82b4190 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:20.602895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1beb03-5b61-437a-9e55-b4bcc82b4190 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:20.604270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:20.609327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8887ac-54fd-468f-88ba-a2b0dce11441 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:20.609761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8887ac-54fd-468f-88ba-a2b0dce11441 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:20.609873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8887ac-54fd-468f-88ba-a2b0dce11441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:20.690643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7d8887ac-54fd-468f-88ba-a2b0dce11441 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:20.691898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7d8887ac-54fd-468f-88ba-a2b0dce11441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:20.790711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:20.942821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1beb03-5b61-437a-9e55-b4bcc82b4190 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:20.944411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-af1beb03-5b61-437a-9e55-b4bcc82b4190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:20.993144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:21.093404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1beb03-5b61-437a-9e55-b4bcc82b4190 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:21.210108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b6239-8ba7-4130-b512-e4f9fcf915bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:21.210299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b6239-8ba7-4130-b512-e4f9fcf915bc service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:21.211126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b6239-8ba7-4130-b512-e4f9fcf915bc service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:21.211387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b6239-8ba7-4130-b512-e4f9fcf915bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:21.212988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a97b6239-8ba7-4130-b512-e4f9fcf915bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:21.220197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:21.302233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b6239-8ba7-4130-b512-e4f9fcf915bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:21.303859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b6239-8ba7-4130-b512-e4f9fcf915bc service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:21.322335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 729/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:22.144753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66760d-36b4-4a71-a6bd-dd91e661a942 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:22.145292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66760d-36b4-4a71-a6bd-dd91e661a942 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:22.145292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66760d-36b4-4a71-a6bd-dd91e661a942 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:22.147973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:22.153049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466246b-5820-4a8b-8fbe-182d6f6a2d22 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:22.153501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466246b-5820-4a8b-8fbe-182d6f6a2d22 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:22.153606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466246b-5820-4a8b-8fbe-182d6f6a2d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:22.230925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-2466246b-5820-4a8b-8fbe-182d6f6a2d22 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:22.232147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2466246b-5820-4a8b-8fbe-182d6f6a2d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:22.304228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:22.334181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:41:22.489159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66760d-36b4-4a71-a6bd-dd91e661a942 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:22.490693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ad66760d-36b4-4a71-a6bd-dd91e661a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:22.510526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:22.643138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66760d-36b4-4a71-a6bd-dd91e661a942 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:22.731304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:22.758413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bd02-5b1a-4689-8959-9afe87c9bf92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:22.759248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bd02-5b1a-4689-8959-9afe87c9bf92 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:22.759527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bd02-5b1a-4689-8959-9afe87c9bf92 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:22.759795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bd02-5b1a-4689-8959-9afe87c9bf92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:22.761434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0f89bd02-5b1a-4689-8959-9afe87c9bf92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:22.852489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bd02-5b1a-4689-8959-9afe87c9bf92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:22.854378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bd02-5b1a-4689-8959-9afe87c9bf92 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:22.874031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 704/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:23.691906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b5c18-59a5-4656-9d36-58f82f4817c9 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:23.692468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b5c18-59a5-4656-9d36-58f82f4817c9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:23.692468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b5c18-59a5-4656-9d36-58f82f4817c9 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:23.693823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:23.698845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c97923-d7f9-49f9-9cf1-e432b0f7e775 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:23.699241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c97923-d7f9-49f9-9cf1-e432b0f7e775 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:23.699420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c97923-d7f9-49f9-9cf1-e432b0f7e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:23.781637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-19c97923-d7f9-49f9-9cf1-e432b0f7e775 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:23.782877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-19c97923-d7f9-49f9-9cf1-e432b0f7e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:23.824998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:23.887513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:24.042470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b5c18-59a5-4656-9d36-58f82f4817c9 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:24.044045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-412b5c18-59a5-4656-9d36-58f82f4817c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:24.195277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b5c18-59a5-4656-9d36-58f82f4817c9 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:24.249879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:24.310646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9194-c775-44ad-972e-6b285a083991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:24.311291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9194-c775-44ad-972e-6b285a083991 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:24.311569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9194-c775-44ad-972e-6b285a083991 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:24.311840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9194-c775-44ad-972e-6b285a083991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:24.313441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1eaa9194-c775-44ad-972e-6b285a083991 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:24.404242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa9194-c775-44ad-972e-6b285a083991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:24.405852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa9194-c775-44ad-972e-6b285a083991 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:24.424756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 732/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:25.235866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a7169-2848-4e98-8cf3-9b61de5e7d2a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:25.236361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a7169-2848-4e98-8cf3-9b61de5e7d2a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:25.236470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a7169-2848-4e98-8cf3-9b61de5e7d2a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:25.237812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:25.243754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aa809-4b7d-4fb0-963c-830725f07a27 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:25.244176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aa809-4b7d-4fb0-963c-830725f07a27 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:25.244341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aa809-4b7d-4fb0-963c-830725f07a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:25.324061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-996aa809-4b7d-4fb0-963c-830725f07a27 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:25.325240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-996aa809-4b7d-4fb0-963c-830725f07a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:25.327307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:25.424649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:25.581705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a7169-2848-4e98-8cf3-9b61de5e7d2a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:25.583207 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a41a7169-2848-4e98-8cf3-9b61de5e7d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:25.733941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a7169-2848-4e98-8cf3-9b61de5e7d2a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:25.762545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:25.852340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a803073-e17c-4b31-b241-448e19f373f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:25.852855 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a803073-e17c-4b31-b241-448e19f373f0 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:25.853131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a803073-e17c-4b31-b241-448e19f373f0 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:25.853399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a803073-e17c-4b31-b241-448e19f373f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:25.855048 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1a803073-e17c-4b31-b241-448e19f373f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:25.958103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a803073-e17c-4b31-b241-448e19f373f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:25.959750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a803073-e17c-4b31-b241-448e19f373f0 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:25.979902 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 707/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:27.785207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f9882-e6ff-42f5-8823-e6c3c2150d85 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:27.785760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f9882-e6ff-42f5-8823-e6c3c2150d85 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:27.785760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f9882-e6ff-42f5-8823-e6c3c2150d85 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:27.787179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:27.794045 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b5b43-02d2-4222-88b4-6d7e0054230c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:27.794510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b5b43-02d2-4222-88b4-6d7e0054230c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:27.794625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b5b43-02d2-4222-88b4-6d7e0054230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:27.836118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:27.862346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ae1b5b43-02d2-4222-88b4-6d7e0054230c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:27.863540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ae1b5b43-02d2-4222-88b4-6d7e0054230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:27.963227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:28.249860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f9882-e6ff-42f5-8823-e6c3c2150d85 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:28.251494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b75f9882-e6ff-42f5-8823-e6c3c2150d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:28.354096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f9882-e6ff-42f5-8823-e6c3c2150d85 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:28.385916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:28.427720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2c53a-e219-483a-89eb-5243ec9d234e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:28.428324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2c53a-e219-483a-89eb-5243ec9d234e service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:28.428598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2c53a-e219-483a-89eb-5243ec9d234e service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:28.428866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2c53a-e219-483a-89eb-5243ec9d234e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:28.431261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-24f2c53a-e219-483a-89eb-5243ec9d234e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:28.542522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2c53a-e219-483a-89eb-5243ec9d234e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:28.543908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2c53a-e219-483a-89eb-5243ec9d234e service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:28.562775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 735/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:30.719844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b9efb-3531-4523-b458-5cefb4bf4696 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:30.720440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b9efb-3531-4523-b458-5cefb4bf4696 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:30.720440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b9efb-3531-4523-b458-5cefb4bf4696 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:30.721794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:30.728004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb8214-2b4a-4a7f-8eb5-10d348fd30fb None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:30.732767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb8214-2b4a-4a7f-8eb5-10d348fd30fb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:30.732767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb8214-2b4a-4a7f-8eb5-10d348fd30fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:30.802886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-30cb8214-2b4a-4a7f-8eb5-10d348fd30fb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:30.804776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-30cb8214-2b4a-4a7f-8eb5-10d348fd30fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:30.821826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:30.918383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:31.205107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b9efb-3531-4523-b458-5cefb4bf4696 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:31.206707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5a2b9efb-3531-4523-b458-5cefb4bf4696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:31.316871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b9efb-3531-4523-b458-5cefb4bf4696 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:31.329068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:31.391770 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea82b2-6d02-46e0-8c6c-2c59c824a166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:31.392373 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea82b2-6d02-46e0-8c6c-2c59c824a166 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:31.392652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea82b2-6d02-46e0-8c6c-2c59c824a166 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:31.392929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea82b2-6d02-46e0-8c6c-2c59c824a166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:31.394520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3cea82b2-6d02-46e0-8c6c-2c59c824a166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:31.503484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea82b2-6d02-46e0-8c6c-2c59c824a166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:31.504845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea82b2-6d02-46e0-8c6c-2c59c824a166 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:31.524774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 710/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:33.757799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64041c2-679b-4ba9-842d-cb1d2e9df83d None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:33.758332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64041c2-679b-4ba9-842d-cb1d2e9df83d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:33.758332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64041c2-679b-4ba9-842d-cb1d2e9df83d None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:33.759994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:33.765492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3f0b4-ff03-4774-8cc1-883435ae79af None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:33.765925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3f0b4-ff03-4774-8cc1-883435ae79af None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:33.766042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3f0b4-ff03-4774-8cc1-883435ae79af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:33.815184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:33.834231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fbf3f0b4-ff03-4774-8cc1-883435ae79af None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:33.836371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fbf3f0b4-ff03-4774-8cc1-883435ae79af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:33.944308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:34.232121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64041c2-679b-4ba9-842d-cb1d2e9df83d None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:34.233678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c64041c2-679b-4ba9-842d-cb1d2e9df83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:34.336563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64041c2-679b-4ba9-842d-cb1d2e9df83d None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:34.376768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:34.410444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58404a05-2bed-4945-a318-22d23a0b8962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:34.411072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404a05-2bed-4945-a318-22d23a0b8962 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:34.411349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404a05-2bed-4945-a318-22d23a0b8962 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:34.411619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404a05-2bed-4945-a318-22d23a0b8962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:34.413720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-58404a05-2bed-4945-a318-22d23a0b8962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:34.522334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58404a05-2bed-4945-a318-22d23a0b8962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:34.524284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58404a05-2bed-4945-a318-22d23a0b8962 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:34.542703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 738/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:36.672081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37113d79-7190-4c7b-a7bb-e24237c6ad59 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:36.672647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37113d79-7190-4c7b-a7bb-e24237c6ad59 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:36.672647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37113d79-7190-4c7b-a7bb-e24237c6ad59 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:36.673975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:36.679749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63682b27-dc47-4a85-9589-200f3ecec1c1 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:36.680234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63682b27-dc47-4a85-9589-200f3ecec1c1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:36.680354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63682b27-dc47-4a85-9589-200f3ecec1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:36.747033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-63682b27-dc47-4a85-9589-200f3ecec1c1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:36.748293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-63682b27-dc47-4a85-9589-200f3ecec1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:36.768882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:36.847264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:37.128445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37113d79-7190-4c7b-a7bb-e24237c6ad59 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:37.130010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-37113d79-7190-4c7b-a7bb-e24237c6ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:37.239051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37113d79-7190-4c7b-a7bb-e24237c6ad59 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:37.260703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:37.316394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83de5f9-e7ee-447d-a337-659d9da43811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:37.316992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83de5f9-e7ee-447d-a337-659d9da43811 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:37.317265 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83de5f9-e7ee-447d-a337-659d9da43811 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:37.317539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83de5f9-e7ee-447d-a337-659d9da43811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:37.319170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c83de5f9-e7ee-447d-a337-659d9da43811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:37.435237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83de5f9-e7ee-447d-a337-659d9da43811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:37.436244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83de5f9-e7ee-447d-a337-659d9da43811 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:37.456371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 713/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:39.456601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2fe24-9b90-4fc8-b883-1f10ae1450b1 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:39.457140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2fe24-9b90-4fc8-b883-1f10ae1450b1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:39.457140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2fe24-9b90-4fc8-b883-1f10ae1450b1 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:39.458470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:39.464697 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0d4e0-26e8-4838-993a-473db5af9ec1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:39.465126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0d4e0-26e8-4838-993a-473db5af9ec1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:39.465230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0d4e0-26e8-4838-993a-473db5af9ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:39.530977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:39.534005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0bc0d4e0-26e8-4838-993a-473db5af9ec1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:39.535696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0bc0d4e0-26e8-4838-993a-473db5af9ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:39.635053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:39.920813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2fe24-9b90-4fc8-b883-1f10ae1450b1 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:39.922449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-63b2fe24-9b90-4fc8-b883-1f10ae1450b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:40.155052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2fe24-9b90-4fc8-b883-1f10ae1450b1 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:40.204919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:40.230418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff427d9-c8e6-4f5f-82a1-23d943ee1c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:40.231184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff427d9-c8e6-4f5f-82a1-23d943ee1c83 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:40.231458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff427d9-c8e6-4f5f-82a1-23d943ee1c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:40.231723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff427d9-c8e6-4f5f-82a1-23d943ee1c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:40.233302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8ff427d9-c8e6-4f5f-82a1-23d943ee1c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:40.341593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff427d9-c8e6-4f5f-82a1-23d943ee1c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:40.343058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff427d9-c8e6-4f5f-82a1-23d943ee1c83 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:40.360580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 741/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:42.336106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088085a-676c-4f1e-bcf1-fcca7345eb2b None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:42.336683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088085a-676c-4f1e-bcf1-fcca7345eb2b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:42.336683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088085a-676c-4f1e-bcf1-fcca7345eb2b None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:42.338088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:42.343274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4ae0-74c8-4ab6-867b-fe6fcdb9e839 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:42.343778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4ae0-74c8-4ab6-867b-fe6fcdb9e839 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:42.343879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4ae0-74c8-4ab6-867b-fe6fcdb9e839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:42.411462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c83b4ae0-74c8-4ab6-867b-fe6fcdb9e839 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:42.412687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c83b4ae0-74c8-4ab6-867b-fe6fcdb9e839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:42.442350 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:42.511166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:42.816164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088085a-676c-4f1e-bcf1-fcca7345eb2b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:42.817841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4088085a-676c-4f1e-bcf1-fcca7345eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:42.938025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088085a-676c-4f1e-bcf1-fcca7345eb2b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:42.970855 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:43.016940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771ce66-961b-4114-a7e7-d9cba1f23bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:43.017544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771ce66-961b-4114-a7e7-d9cba1f23bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:43.017818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771ce66-961b-4114-a7e7-d9cba1f23bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:43.018086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771ce66-961b-4114-a7e7-d9cba1f23bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:43.019713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1771ce66-961b-4114-a7e7-d9cba1f23bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:43.131022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771ce66-961b-4114-a7e7-d9cba1f23bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:43.133162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771ce66-961b-4114-a7e7-d9cba1f23bf3 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:43.152734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 716/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:45.187986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8107f-8b21-4a57-beec-b1f9e72a2973 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:45.188590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8107f-8b21-4a57-beec-b1f9e72a2973 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:45.188590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8107f-8b21-4a57-beec-b1f9e72a2973 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:45.189904 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:45.196609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e116-aab7-49e3-a222-806fb5f2205a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:45.197075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e116-aab7-49e3-a222-806fb5f2205a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:45.197174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e116-aab7-49e3-a222-806fb5f2205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:45.265269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0ff2e116-aab7-49e3-a222-806fb5f2205a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:45.266502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0ff2e116-aab7-49e3-a222-806fb5f2205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:45.274840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:45.363709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:45.656081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8107f-8b21-4a57-beec-b1f9e72a2973 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:45.657629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-dfa8107f-8b21-4a57-beec-b1f9e72a2973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:45.766180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8107f-8b21-4a57-beec-b1f9e72a2973 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:45.821768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:45.840867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e3b49-ca72-4964-88e9-26bea04670bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:45.841479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e3b49-ca72-4964-88e9-26bea04670bb service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:45.841756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e3b49-ca72-4964-88e9-26bea04670bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:45.842023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e3b49-ca72-4964-88e9-26bea04670bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:45.843670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f75e3b49-ca72-4964-88e9-26bea04670bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:45.962029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e3b49-ca72-4964-88e9-26bea04670bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:45.963500 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e3b49-ca72-4964-88e9-26bea04670bb service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:45.981927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 744/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:47.946890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8661-5047-4cf9-9d37-77cc231c76ff None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:47.947484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8661-5047-4cf9-9d37-77cc231c76ff None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:47.947484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8661-5047-4cf9-9d37-77cc231c76ff None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:47.948804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:47.954314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca9c0e-300a-4dd1-987d-b2b4547692b0 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:47.954759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca9c0e-300a-4dd1-987d-b2b4547692b0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:47.954922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca9c0e-300a-4dd1-987d-b2b4547692b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:48.027521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-73ca9c0e-300a-4dd1-987d-b2b4547692b0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:48.028751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-73ca9c0e-300a-4dd1-987d-b2b4547692b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:48.067366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:48.127737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:48.415611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d8661-5047-4cf9-9d37-77cc231c76ff None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:48.417158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b56d8661-5047-4cf9-9d37-77cc231c76ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:48.523604 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d8661-5047-4cf9-9d37-77cc231c76ff None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:48.562425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:48.600623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fdc2f-3da3-40eb-8b48-5697783db5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:48.601478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fdc2f-3da3-40eb-8b48-5697783db5cd service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:48.601756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fdc2f-3da3-40eb-8b48-5697783db5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:48.602045 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fdc2f-3da3-40eb-8b48-5697783db5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:48.603711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-244fdc2f-3da3-40eb-8b48-5697783db5cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:48.716010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fdc2f-3da3-40eb-8b48-5697783db5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:48.717465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fdc2f-3da3-40eb-8b48-5697783db5cd service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:48.738917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 719/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:50.682687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c035c2-5fa9-4644-b3db-7dabd0e8ba9f None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:50.683360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c035c2-5fa9-4644-b3db-7dabd0e8ba9f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:50.683360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c035c2-5fa9-4644-b3db-7dabd0e8ba9f None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:50.684856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:50.690715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe0cb-9372-4836-af68-6be6fb15fb80 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:50.691280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe0cb-9372-4836-af68-6be6fb15fb80 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:50.691389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe0cb-9372-4836-af68-6be6fb15fb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:50.763097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-afbfe0cb-9372-4836-af68-6be6fb15fb80 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:50.764847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-afbfe0cb-9372-4836-af68-6be6fb15fb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:50.784017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:50.864334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:51.159777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c035c2-5fa9-4644-b3db-7dabd0e8ba9f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:51.161350 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-79c035c2-5fa9-4644-b3db-7dabd0e8ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:51.287387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c035c2-5fa9-4644-b3db-7dabd0e8ba9f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:51.366666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:51.375539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e298cc2-9c37-4f0c-a0e5-f4c2b8dc6f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:51.376149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e298cc2-9c37-4f0c-a0e5-f4c2b8dc6f7e service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:51.376419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e298cc2-9c37-4f0c-a0e5-f4c2b8dc6f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:51.376682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e298cc2-9c37-4f0c-a0e5-f4c2b8dc6f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:51.378265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9e298cc2-9c37-4f0c-a0e5-f4c2b8dc6f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:51.492912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e298cc2-9c37-4f0c-a0e5-f4c2b8dc6f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:51.494346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e298cc2-9c37-4f0c-a0e5-f4c2b8dc6f7e service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:51.513017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 747/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:41:53.473001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3da5d-f7e6-4892-a029-c20863d5d60c None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:53.473609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3da5d-f7e6-4892-a029-c20863d5d60c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:53.473609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3da5d-f7e6-4892-a029-c20863d5d60c None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:53.474932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:41:53.481003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04e280-c57c-4d46-8028-1f06f8bdc12c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:53.481444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04e280-c57c-4d46-8028-1f06f8bdc12c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:53.481544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04e280-c57c-4d46-8028-1f06f8bdc12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:53.549465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8a04e280-c57c-4d46-8028-1f06f8bdc12c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:41:53.550684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8a04e280-c57c-4d46-8028-1f06f8bdc12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:53.600895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:53.652392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:41:53.935416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3da5d-f7e6-4892-a029-c20863d5d60c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:41:53.936959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-79b3da5d-f7e6-4892-a029-c20863d5d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:54.041851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3da5d-f7e6-4892-a029-c20863d5d60c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:41:54.090240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:41:54.119699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999d775-f87c-42b3-b2b7-ed375f02bc17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:41:54.120309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999d775-f87c-42b3-b2b7-ed375f02bc17 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:41:54.120590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999d775-f87c-42b3-b2b7-ed375f02bc17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:41:54.120861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999d775-f87c-42b3-b2b7-ed375f02bc17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:41:54.122472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e999d775-f87c-42b3-b2b7-ed375f02bc17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:41:54.234857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999d775-f87c-42b3-b2b7-ed375f02bc17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:41:54.236222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999d775-f87c-42b3-b2b7-ed375f02bc17 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:41:54.254878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 722/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:42:03.650548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=22 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:04.252594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=66 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:13.799878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb091-d27a-47f3-b09b-f0392ae0854e None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:13.800476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb091-d27a-47f3-b09b-f0392ae0854e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:13.800476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb091-d27a-47f3-b09b-f0392ae0854e None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:13.801790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 749/1471] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:42:13.807722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a632e04-8c61-4d1f-9e62-3050479e6c57 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:13.808190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a632e04-8c61-4d1f-9e62-3050479e6c57 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:13.808303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a632e04-8c61-4d1f-9e62-3050479e6c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:13.875400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0a632e04-8c61-4d1f-9e62-3050479e6c57 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:42:13.876553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0a632e04-8c61-4d1f-9e62-3050479e6c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:13.976965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 723/1472] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:42:14.271119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e10457-9c25-4f16-b7e7-115c41d3a03b None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:14.271894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e10457-9c25-4f16-b7e7-115c41d3a03b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:14.272373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e10457-9c25-4f16-b7e7-115c41d3a03b None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:14.273724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 750/1473] 10.222.0.65 () {54 vars in 967 bytes} [Thu Aug 18 20:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:42:14.278655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abda0-9f7c-49cf-bba0-b83dd9f7c004 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:14.278976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abda0-9f7c-49cf-bba0-b83dd9f7c004 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:14.279255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abda0-9f7c-49cf-bba0-b83dd9f7c004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:14.360804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-da9abda0-9f7c-49cf-bba0-b83dd9f7c004 None None] MFA Rules not processed for user `0d4e9baa7a6241b1807c67844c7d424c`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:42:14.362015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-da9abda0-9f7c-49cf-bba0-b83dd9f7c004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:14.382149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:14.437368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 724/1474] 10.222.0.65 () {58 vars in 1064 bytes} [Thu Aug 18 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:42:14.445472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e10457-9c25-4f16-b7e7-115c41d3a03b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:42:14.447383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f7e10457-9c25-4f16-b7e7-115c41d3a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:14.551587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e10457-9c25-4f16-b7e7-115c41d3a03b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:42:14.625678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41af95a-3b85-4ad0-a757-8525d0304b61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d4e9baa7a6241b1807c67844c7d424c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:42:14.626326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af95a-3b85-4ad0-a757-8525d0304b61 service glance] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:14.626603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af95a-3b85-4ad0-a757-8525d0304b61 service glance] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:14.626906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af95a-3b85-4ad0-a757-8525d0304b61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:14.628558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f41af95a-3b85-4ad0-a757-8525d0304b61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:14.686524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:14.744338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41af95a-3b85-4ad0-a757-8525d0304b61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:42:14.745790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41af95a-3b85-4ad0-a757-8525d0304b61 service glance] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:42:14.765205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 751/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:42:16.828146 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827388c5-3887-44aa-85e7-be590e6ed216 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:16.828712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827388c5-3887-44aa-85e7-be590e6ed216 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:16.828712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827388c5-3887-44aa-85e7-be590e6ed216 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:16.830037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 725/1476] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:42:16.835519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5378a-9b90-4f9a-aa84-70c91c63cda8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:16.835945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5378a-9b90-4f9a-aa84-70c91c63cda8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:16.836075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5378a-9b90-4f9a-aa84-70c91c63cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:16.903750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8dd5378a-9b90-4f9a-aa84-70c91c63cda8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:42:16.904903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8dd5378a-9b90-4f9a-aa84-70c91c63cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:17.007831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 752/1477] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:42:17.284163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827388c5-3887-44aa-85e7-be590e6ed216 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:42:17.285684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-827388c5-3887-44aa-85e7-be590e6ed216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:17.422734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827388c5-3887-44aa-85e7-be590e6ed216 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:42:17.472517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:17.518652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d2343-c2fe-4f93-9df6-071f895e02cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:42:17.519205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d2343-c2fe-4f93-9df6-071f895e02cf admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:17.519482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d2343-c2fe-4f93-9df6-071f895e02cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:17.519750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d2343-c2fe-4f93-9df6-071f895e02cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:17.520379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d2343-c2fe-4f93-9df6-071f895e02cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:42:17.522701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WARNING py.warnings [None req-009d2343-c2fe-4f93-9df6-071f895e02cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:42:17.522701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: warnings.warn(msg) Aug 18 20:42:17.522701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: Aug 18 20:42:17.523859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d2343-c2fe-4f93-9df6-071f895e02cf admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:42:17.543123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 726/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Aug 18 20:42:17 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:42:19.532370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2065ff2-5990-4135-8c9d-6470b6a1f710 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:19.533021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2065ff2-5990-4135-8c9d-6470b6a1f710 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:19.533021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2065ff2-5990-4135-8c9d-6470b6a1f710 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:19.534221 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 753/1479] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:42:19.540440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca79fbf-70f5-410d-a2ad-24062fcac262 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:19.540919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca79fbf-70f5-410d-a2ad-24062fcac262 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:19.541018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca79fbf-70f5-410d-a2ad-24062fcac262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:19.617441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8ca79fbf-70f5-410d-a2ad-24062fcac262 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:42:19.618679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8ca79fbf-70f5-410d-a2ad-24062fcac262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:19.718655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 727/1480] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:42:20.014584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2065ff2-5990-4135-8c9d-6470b6a1f710 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:42:20.016180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a2065ff2-5990-4135-8c9d-6470b6a1f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:20.027214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:20.169074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2065ff2-5990-4135-8c9d-6470b6a1f710 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:42:20.248850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:20.283034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65b1b-cb49-40d9-b75d-69e84d096535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:42:20.283642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65b1b-cb49-40d9-b75d-69e84d096535 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:20.283915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65b1b-cb49-40d9-b75d-69e84d096535 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:20.284181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65b1b-cb49-40d9-b75d-69e84d096535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:20.285763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-67e65b1b-cb49-40d9-b75d-69e84d096535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:20.376668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e65b1b-cb49-40d9-b75d-69e84d096535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:42:20.378411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e65b1b-cb49-40d9-b75d-69e84d096535 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:42:20.398265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 754/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:42:22.495744 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032044e0-13de-4a4b-9c5c-2530c08ab0ab None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:22.496338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032044e0-13de-4a4b-9c5c-2530c08ab0ab None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:22.496338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032044e0-13de-4a4b-9c5c-2530c08ab0ab None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:22.497678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 728/1482] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:42:22.502902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2478-dbc2-4fb4-a255-531a4bb1962d None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:22.503315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2478-dbc2-4fb4-a255-531a4bb1962d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:22.503467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2478-dbc2-4fb4-a255-531a4bb1962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:22.570672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-fd7f2478-dbc2-4fb4-a255-531a4bb1962d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:42:22.571927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-fd7f2478-dbc2-4fb4-a255-531a4bb1962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:22.619073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:22.672811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 755/1483] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:42:22.960240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032044e0-13de-4a4b-9c5c-2530c08ab0ab None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:42:22.961787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-032044e0-13de-4a4b-9c5c-2530c08ab0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:22.985137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:23.067490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032044e0-13de-4a4b-9c5c-2530c08ab0ab None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:42:23.144897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73d459-e2e7-4282-929c-b5549ea4fbf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:42:23.145508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73d459-e2e7-4282-929c-b5549ea4fbf1 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:23.145789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73d459-e2e7-4282-929c-b5549ea4fbf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:23.146061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73d459-e2e7-4282-929c-b5549ea4fbf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:23.148572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3b73d459-e2e7-4282-929c-b5549ea4fbf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:23.224645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:23.263655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73d459-e2e7-4282-929c-b5549ea4fbf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:42:23.265200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73d459-e2e7-4282-929c-b5549ea4fbf1 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:42:23.285036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 729/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:42:25.267626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572b43-67ea-43e1-9fa5-81b62ed36cd8 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:25.268123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572b43-67ea-43e1-9fa5-81b62ed36cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:25.268226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572b43-67ea-43e1-9fa5-81b62ed36cd8 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:25.269535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 756/1485] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:42:25.277450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff69b0-9e47-47b3-a67e-dad795afc2c4 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:25.278167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff69b0-9e47-47b3-a67e-dad795afc2c4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:25.278167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff69b0-9e47-47b3-a67e-dad795afc2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:25.348555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-66ff69b0-9e47-47b3-a67e-dad795afc2c4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:42:25.350925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-66ff69b0-9e47-47b3-a67e-dad795afc2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:25.450102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 730/1486] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:42:25.744570 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572b43-67ea-43e1-9fa5-81b62ed36cd8 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:42:25.746126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b7572b43-67ea-43e1-9fa5-81b62ed36cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:25.851559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572b43-67ea-43e1-9fa5-81b62ed36cd8 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:42:25.925486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:25.927587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dd4f1-77e9-4873-99c9-1a60d5dd7850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:42:25.928222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dd4f1-77e9-4873-99c9-1a60d5dd7850 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:25.928707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dd4f1-77e9-4873-99c9-1a60d5dd7850 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:25.929026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dd4f1-77e9-4873-99c9-1a60d5dd7850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:25.931013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-431dd4f1-77e9-4873-99c9-1a60d5dd7850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:26.041034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dd4f1-77e9-4873-99c9-1a60d5dd7850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:42:26.042461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dd4f1-77e9-4873-99c9-1a60d5dd7850 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:42:26.060152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 757/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:42:28.213053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c08bf2-90a7-419a-88fe-ce0b27a2cb5e None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:28.213653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c08bf2-90a7-419a-88fe-ce0b27a2cb5e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:28.213653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c08bf2-90a7-419a-88fe-ce0b27a2cb5e None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:28.215004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 731/1488] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:42:28.220171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e401a9e-b15a-488b-a55c-0576d4dc6351 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:28.220560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e401a9e-b15a-488b-a55c-0576d4dc6351 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:28.220720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e401a9e-b15a-488b-a55c-0576d4dc6351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:28.288307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5e401a9e-b15a-488b-a55c-0576d4dc6351 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:42:28.289537 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5e401a9e-b15a-488b-a55c-0576d4dc6351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:28.341460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:28.387105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 758/1489] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:42:28.679372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c08bf2-90a7-419a-88fe-ce0b27a2cb5e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:42:28.680901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-14c08bf2-90a7-419a-88fe-ce0b27a2cb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:28.716896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:28.788396 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c08bf2-90a7-419a-88fe-ce0b27a2cb5e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:42:28.862431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e63e9-fec4-4838-8186-0b8ba6860efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:42:28.862987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e63e9-fec4-4838-8186-0b8ba6860efe service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:28.863266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e63e9-fec4-4838-8186-0b8ba6860efe service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:28.863533 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e63e9-fec4-4838-8186-0b8ba6860efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:28.865258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-480e63e9-fec4-4838-8186-0b8ba6860efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:28.951123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:28.984063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e63e9-fec4-4838-8186-0b8ba6860efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:42:28.985519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e63e9-fec4-4838-8186-0b8ba6860efe service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:42:29.004555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 732/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:42:31.177310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4bd81-ce18-4e70-b36d-34654636e2bb None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:31.177878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4bd81-ce18-4e70-b36d-34654636e2bb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:31.177878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4bd81-ce18-4e70-b36d-34654636e2bb None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:31.179254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 759/1491] 10.222.0.65 () {54 vars in 927 bytes} [Thu Aug 18 20:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:42:31.184672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91906e-5fee-48f9-a8ab-263754cd0195 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:31.185141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91906e-5fee-48f9-a8ab-263754cd0195 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:31.185238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91906e-5fee-48f9-a8ab-263754cd0195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:31.254131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6c91906e-5fee-48f9-a8ab-263754cd0195 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:42:31.255916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6c91906e-5fee-48f9-a8ab-263754cd0195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:31.353227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 733/1492] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Aug 18 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:42:31.649421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4bd81-ce18-4e70-b36d-34654636e2bb None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:42:31.651260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8ce4bd81-ce18-4e70-b36d-34654636e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:31.764189 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4bd81-ce18-4e70-b36d-34654636e2bb None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:42:31.837647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fd66b-15f1-4526-8ca6-7486d3174eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:42:31.838248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fd66b-15f1-4526-8ca6-7486d3174eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:42:31.838528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fd66b-15f1-4526-8ca6-7486d3174eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:42:31.838809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fd66b-15f1-4526-8ca6-7486d3174eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:42:31.840390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-106fd66b-15f1-4526-8ca6-7486d3174eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:42:31.849479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:31.957464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fd66b-15f1-4526-8ca6-7486d3174eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:42:31.960125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fd66b-15f1-4526-8ca6-7486d3174eb6 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:42:31.978020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 760/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:42:41.351304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=82 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:42:41.975652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=50 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:51.204042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227dae6-f863-4815-98a0-392837454dcd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:51.204695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227dae6-f863-4815-98a0-392837454dcd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:51.204695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227dae6-f863-4815-98a0-392837454dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:51.293467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e227dae6-f863-4815-98a0-392837454dcd None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:43:51.294733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e227dae6-f863-4815-98a0-392837454dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:51.393015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 734/1494] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:43:51.401857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f937a7-d23e-4552-bb41-66e677bb01e5 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:51.402374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f937a7-d23e-4552-bb41-66e677bb01e5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:51.402374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f937a7-d23e-4552-bb41-66e677bb01e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:51.478679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e8f937a7-d23e-4552-bb41-66e677bb01e5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:43:51.479950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e8f937a7-d23e-4552-bb41-66e677bb01e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:51.580136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 761/1495] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:43:51.585187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227dae6-f863-4815-98a0-392837454dcd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:51.586405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e227dae6-f863-4815-98a0-392837454dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:51.598739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227dae6-f863-4815-98a0-392837454dcd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:51.662181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:51.696628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:51.697229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:51.697504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:51.697772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:51.698405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:43:51.698699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:51.699738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WARNING py.warnings [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:43:51.699738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: warnings.warn(msg) Aug 18 20:43:51.699738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: Aug 18 20:43:51.700613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:51.712267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 735/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:43:51.721081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f937a7-d23e-4552-bb41-66e677bb01e5 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:51.731861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f937a7-d23e-4552-bb41-66e677bb01e5 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:51.805741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:51.845993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:51.846602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:51.846909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:51.847181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:51.848431 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:51.850285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WARNING py.warnings [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:43:51.850285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: warnings.warn(msg) Aug 18 20:43:51.850285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: Aug 18 20:43:51.851553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:51.912768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 762/1497] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:43:51 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:43:51.916711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:51.918237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:51.952279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51b5b-e796-4a0e-82e1-99cf69102306 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:52.051019 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:52.051630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:52.051908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:52.052184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:52.052810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:52.053824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WARNING py.warnings [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:43:52.053824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: warnings.warn(msg) Aug 18 20:43:52.053824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: Aug 18 20:43:52.055053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:52.100526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 736/1498] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:43:51 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:43:52.105686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:52.107880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:52.177492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e96fc4-dca3-4eea-ba40-68a7e43a3423 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:52.264530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:52.278539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:52.279324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:52.279678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:52.280041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:52.280694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:52.281800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WARNING py.warnings [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:43:52.281800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: warnings.warn(msg) Aug 18 20:43:52.281800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: Aug 18 20:43:52.282712 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:52.295990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 763/1499] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:43:52.300126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:52.301810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:52.317821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed4852-7966-4e0e-952b-223275802915 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:52.344868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:52.422577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640d48-4b89-4e2f-aa97-84991911747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:52.423226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640d48-4b89-4e2f-aa97-84991911747f admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:52.423509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640d48-4b89-4e2f-aa97-84991911747f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:52.423783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640d48-4b89-4e2f-aa97-84991911747f admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:52.424443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce640d48-4b89-4e2f-aa97-84991911747f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:52.425494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WARNING py.warnings [None req-ce640d48-4b89-4e2f-aa97-84991911747f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:43:52.425494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: warnings.warn(msg) Aug 18 20:43:52.425494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: Aug 18 20:43:52.427246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce640d48-4b89-4e2f-aa97-84991911747f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:52.443436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 737/1500] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:43:52.448007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:52.449950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:52.482553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1cc0-c813-4b8c-b7a6-25ac10b11919 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:52.577249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c9a24-488d-42df-b154-9dbce1ab4e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:52.577908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c9a24-488d-42df-b154-9dbce1ab4e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:52.578185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c9a24-488d-42df-b154-9dbce1ab4e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:52.578454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c9a24-488d-42df-b154-9dbce1ab4e6f admin admin] PATH_INFO: `/v3/projects/e27160b83d324797bd3c8e5f5a779609/users/3b216955b39d4331b88ba043fb2b94cf/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:52.602270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c9a24-488d-42df-b154-9dbce1ab4e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27160b83d324797bd3c8e5f5a779609, user_id=3b216955b39d4331b88ba043fb2b94cf, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:52.603367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WARNING py.warnings [None req-fc0c9a24-488d-42df-b154-9dbce1ab4e6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:43:52.603367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: warnings.warn(msg) Aug 18 20:43:52.603367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: Aug 18 20:43:52.605338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c9a24-488d-42df-b154-9dbce1ab4e6f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:52.634564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 764/1501] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:43:52 2022] PUT /identity/v3/projects/e27160b83d324797bd3c8e5f5a779609/users/3b216955b39d4331b88ba043fb2b94cf/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:43:52.647671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c03c5-c3d7-4450-8087-54ce559d6c18 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:52.647955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c03c5-c3d7-4450-8087-54ce559d6c18 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:52.648261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c03c5-c3d7-4450-8087-54ce559d6c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:52.707990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-154c03c5-c3d7-4450-8087-54ce559d6c18 None None] MFA Rules not processed for user `3b216955b39d4331b88ba043fb2b94cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:43:52.709128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-154c03c5-c3d7-4450-8087-54ce559d6c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:52.787850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 738/1502] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:43:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:43:52.801476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1b0f0-1be7-432d-90d1-53372b0dce89 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:52.801774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1b0f0-1be7-432d-90d1-53372b0dce89 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:52.802101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1b0f0-1be7-432d-90d1-53372b0dce89 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:52.803478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 765/1503] 10.222.0.65 () {54 vars in 964 bytes} [Thu Aug 18 20:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:43:52.808391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a1dd-f210-48ff-ae54-195ec28b5d73 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:52.808690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a1dd-f210-48ff-ae54-195ec28b5d73 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:52.808961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a1dd-f210-48ff-ae54-195ec28b5d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:52.841908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:52.888644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d138a1dd-f210-48ff-ae54-195ec28b5d73 None None] MFA Rules not processed for user `3da4ea5ad2924cf4baef5614929b7e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:43:52.889880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d138a1dd-f210-48ff-ae54-195ec28b5d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:52.966082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 739/1504] 10.222.0.65 () {58 vars in 1061 bytes} [Thu Aug 18 20:43:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:43:52.974536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1b0f0-1be7-432d-90d1-53372b0dce89 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:52.976116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-51c1b0f0-1be7-432d-90d1-53372b0dce89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:53.026409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:53.081865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1b0f0-1be7-432d-90d1-53372b0dce89 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:53.157388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:53.158000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:53.158281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:53.158553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:53.160941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:53.264403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:53.265802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:53.270129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:53.286923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 766/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:43:53.332678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310225d-caf0-4245-8d6a-05211ec873da None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:53.333376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310225d-caf0-4245-8d6a-05211ec873da None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:53.333376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310225d-caf0-4245-8d6a-05211ec873da None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:53.334564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 740/1506] 10.222.0.65 () {52 vars in 830 bytes} [Thu Aug 18 20:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:43:53.338549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:53.339780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:53.441621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92419ba3-1e04-4dad-9915-216006b97151 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:53.548213 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:53.548876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:53.549030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:53.549305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] PATH_INFO: `/v3/users/3b216955b39d4331b88ba043fb2b94cf` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:53.563411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b216955b39d4331b88ba043fb2b94cf)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:53.564452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WARNING py.warnings [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:43:53.564452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: warnings.warn(msg) Aug 18 20:43:53.564452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: Aug 18 20:43:53.565679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:53.576816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:53.636238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b216955b39d4331b88ba043fb2b94cf'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:53.636771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b216955b39d4331b88ba043fb2b94cf'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:53.659736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b216955b39d4331b88ba043fb2b94cf'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:53.670117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b216955b39d4331b88ba043fb2b94cf'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:53.670681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b216955b39d4331b88ba043fb2b94cf'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:53.691307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 767/1507] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:43:53 2022] DELETE /identity/v3/users/3b216955b39d4331b88ba043fb2b94cf => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:43:53.696729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8b707-a671-4598-9463-83ca98a9f359 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:53.697129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8b707-a671-4598-9463-83ca98a9f359 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:53.697474 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8b707-a671-4598-9463-83ca98a9f359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:53.757074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5bb8b707-a671-4598-9463-83ca98a9f359 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:43:53.758337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5bb8b707-a671-4598-9463-83ca98a9f359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:53.835140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:53.848567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 741/1508] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:43:53.858708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:53.859997 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:53.966900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161501-5b09-4c9f-8789-6c974a2e80f9 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:54.023903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:43:54.045404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38282d1-8521-40b7-8b39-4c8f193f56f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:54.046014 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38282d1-8521-40b7-8b39-4c8f193f56f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:54.046288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38282d1-8521-40b7-8b39-4c8f193f56f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:54.046557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38282d1-8521-40b7-8b39-4c8f193f56f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:54.048182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f38282d1-8521-40b7-8b39-4c8f193f56f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:54.155735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38282d1-8521-40b7-8b39-4c8f193f56f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:54.157105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38282d1-8521-40b7-8b39-4c8f193f56f1 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:54.176108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 768/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:43:54.538385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8b707-a671-4598-9463-83ca98a9f359 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:43:54.539702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5bb8b707-a671-4598-9463-83ca98a9f359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:43:54.551721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8b707-a671-4598-9463-83ca98a9f359 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:43:54.661371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:43:54.662002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:43:54.662277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:43:54.662542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] PATH_INFO: `/v3/projects/e27160b83d324797bd3c8e5f5a779609` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:43:54.673436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27160b83d324797bd3c8e5f5a779609)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:43:54.674421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WARNING py.warnings [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:43:54.674421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: warnings.warn(msg) Aug 18 20:43:54.674421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: Aug 18 20:43:54.676235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:43:54.736325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27160b83d324797bd3c8e5f5a779609', 'request_id': 'req-1c669170-392b-4bbe-869b-3d9355af6ea7'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:54.750416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27160b83d324797bd3c8e5f5a779609', 'request_id': 'req-1c669170-392b-4bbe-869b-3d9355af6ea7'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:54.761397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27160b83d324797bd3c8e5f5a779609', 'request_id': 'req-1c669170-392b-4bbe-869b-3d9355af6ea7'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:54.790658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] The token cache is being invalidate because project e27160b83d324797bd3c8e5f5a779609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:43:54.790975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:54.791413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1c669170-392b-4bbe-869b-3d9355af6ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:43:54.792864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 742/1510] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:43:54 2022] DELETE /identity/v3/projects/e27160b83d324797bd3c8e5f5a779609 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:44:04.173715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=62 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:44:04.788528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:31.340541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f522a-d37d-4027-b48b-cb66494ee7a0 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:31.341154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f522a-d37d-4027-b48b-cb66494ee7a0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:31.341154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f522a-d37d-4027-b48b-cb66494ee7a0 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:31.342456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:31.348080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866fff-41b8-4c25-ac95-03a73950b5d9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:31.348506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866fff-41b8-4c25-ac95-03a73950b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:31.348610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866fff-41b8-4c25-ac95-03a73950b5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:31.428163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-83866fff-41b8-4c25-ac95-03a73950b5d9 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:31.429354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-83866fff-41b8-4c25-ac95-03a73950b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:31.535591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:31.690092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f522a-d37d-4027-b48b-cb66494ee7a0 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:31.692251 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f82f522a-d37d-4027-b48b-cb66494ee7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:31.819686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f522a-d37d-4027-b48b-cb66494ee7a0 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:31.825218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccf189-edfe-47b2-8d69-324e5ee60a87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:31.825847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccf189-edfe-47b2-8d69-324e5ee60a87 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:31.826113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccf189-edfe-47b2-8d69-324e5ee60a87 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:31.826472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccf189-edfe-47b2-8d69-324e5ee60a87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:31.835809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccf189-edfe-47b2-8d69-324e5ee60a87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:31.837438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccf189-edfe-47b2-8d69-324e5ee60a87 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:31.849060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 770/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:32.689659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabadcff-2e46-4c46-ae3d-3c69ab91de35 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:32.690290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabadcff-2e46-4c46-ae3d-3c69ab91de35 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:32.690290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabadcff-2e46-4c46-ae3d-3c69ab91de35 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:32.691590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:32.696637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1fd0f-1cac-4e8e-9f8c-c85be61250e4 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:32.697083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1fd0f-1cac-4e8e-9f8c-c85be61250e4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:32.697190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1fd0f-1cac-4e8e-9f8c-c85be61250e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:32.717492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-08a1fd0f-1cac-4e8e-9f8c-c85be61250e4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:32.718717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-08a1fd0f-1cac-4e8e-9f8c-c85be61250e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:32.727447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:32.847875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2fa56-c73a-4c25-a8bb-0e1570894c68 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:32.848080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2fa56-c73a-4c25-a8bb-0e1570894c68 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:32.848332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2fa56-c73a-4c25-a8bb-0e1570894c68 None None] PATH_INFO: `/v3` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:32.849599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 745/1516] 10.222.0.47 () {54 vars in 925 bytes} [Thu Aug 18 20:45:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:45:32.855432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbdb7b-d637-4383-b4e2-09f5f2e65aa6 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:32.855724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbdb7b-d637-4383-b4e2-09f5f2e65aa6 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:32.856001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbdb7b-d637-4383-b4e2-09f5f2e65aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:32.891083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2fa56-c73a-4c25-a8bb-0e1570894c68 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:32.906012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2fa56-c73a-4c25-a8bb-0e1570894c68 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:32.912376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba41483-2e70-48cf-9907-d428529c7060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:32.912981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba41483-2e70-48cf-9907-d428529c7060 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:32.913267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba41483-2e70-48cf-9907-d428529c7060 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:32.913539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba41483-2e70-48cf-9907-d428529c7060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:32.921417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8cbbdb7b-d637-4383-b4e2-09f5f2e65aa6 None None] MFA Rules not processed for user `be696635db224e3a868957eb5b5bae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:32.922300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba41483-2e70-48cf-9907-d428529c7060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:32.922831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8cbbdb7b-d637-4383-b4e2-09f5f2e65aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:32.924059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba41483-2e70-48cf-9907-d428529c7060 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:32.934034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 746/1517] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:45:32.982185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:33.003688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 772/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Aug 18 20:45:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:36.787882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1206-d95a-4e1a-9fb7-ff02a4443d7a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:36.788409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1206-d95a-4e1a-9fb7-ff02a4443d7a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:36.788409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1206-d95a-4e1a-9fb7-ff02a4443d7a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:36.789707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 747/1519] 10.222.0.65 () {54 vars in 961 bytes} [Thu Aug 18 20:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:36.794788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e6860-d343-43c4-885c-a42b8db39254 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:36.795206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e6860-d343-43c4-885c-a42b8db39254 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:36.795351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e6860-d343-43c4-885c-a42b8db39254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:36.816154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-cf6e6860-d343-43c4-885c-a42b8db39254 None None] MFA Rules not processed for user `be696635db224e3a868957eb5b5bae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:36.817380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-cf6e6860-d343-43c4-885c-a42b8db39254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:36.825970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 773/1520] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Aug 18 20:45:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:36.834135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1206-d95a-4e1a-9fb7-ff02a4443d7a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:36.848453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1206-d95a-4e1a-9fb7-ff02a4443d7a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:36.853464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5304c7-27e1-4d3d-b9fd-7b7bbc0b2c09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:36.854100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5304c7-27e1-4d3d-b9fd-7b7bbc0b2c09 service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:36.854380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5304c7-27e1-4d3d-b9fd-7b7bbc0b2c09 service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:36.854656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5304c7-27e1-4d3d-b9fd-7b7bbc0b2c09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:36.863787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5304c7-27e1-4d3d-b9fd-7b7bbc0b2c09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:36.865375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5304c7-27e1-4d3d-b9fd-7b7bbc0b2c09 service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:36.875081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 748/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:44.188964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73867c8f-80fc-4e3f-8780-977c67fc00f9 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:44.189506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73867c8f-80fc-4e3f-8780-977c67fc00f9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:44.189506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73867c8f-80fc-4e3f-8780-977c67fc00f9 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:44.191003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:44.195762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5f1a6-4d1f-4fa2-8170-579a82396e77 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:44.196186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5f1a6-4d1f-4fa2-8170-579a82396e77 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:44.196331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5f1a6-4d1f-4fa2-8170-579a82396e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:44.216317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d3e5f1a6-4d1f-4fa2-8170-579a82396e77 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:44.217528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d3e5f1a6-4d1f-4fa2-8170-579a82396e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:44.225923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:44.379117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73867c8f-80fc-4e3f-8780-977c67fc00f9 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:44.395062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73867c8f-80fc-4e3f-8780-977c67fc00f9 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:44.400437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a38ff6-e0a7-4da1-a50a-5241ba9c538c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:44.401035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a38ff6-e0a7-4da1-a50a-5241ba9c538c service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:44.401316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a38ff6-e0a7-4da1-a50a-5241ba9c538c service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:44.401590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a38ff6-e0a7-4da1-a50a-5241ba9c538c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:44.409990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a38ff6-e0a7-4da1-a50a-5241ba9c538c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:44.411620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a38ff6-e0a7-4da1-a50a-5241ba9c538c service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:44.420992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 775/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:45.244243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544a48b-c5a4-43f0-a36e-55a9f4d0e33d None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:45.244823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544a48b-c5a4-43f0-a36e-55a9f4d0e33d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:45.244823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544a48b-c5a4-43f0-a36e-55a9f4d0e33d None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:45.246118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:45.251339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196600c9-62ae-4652-a7d3-d43a087b979d None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:45.251810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196600c9-62ae-4652-a7d3-d43a087b979d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:45.251921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196600c9-62ae-4652-a7d3-d43a087b979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:45.271985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-196600c9-62ae-4652-a7d3-d43a087b979d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:45.273200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-196600c9-62ae-4652-a7d3-d43a087b979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:45.281002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:45.432426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544a48b-c5a4-43f0-a36e-55a9f4d0e33d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:45.447805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544a48b-c5a4-43f0-a36e-55a9f4d0e33d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:45.453398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81d298-c10e-458d-8722-812a9136e3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:45.454002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81d298-c10e-458d-8722-812a9136e3b5 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:45.454278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81d298-c10e-458d-8722-812a9136e3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:45.454557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81d298-c10e-458d-8722-812a9136e3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:45.462704 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81d298-c10e-458d-8722-812a9136e3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:45.464339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81d298-c10e-458d-8722-812a9136e3b5 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:45.473834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 751/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:49.428944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31d32b-98a5-4964-ad80-ee9c3c169e5c None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:49.429530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31d32b-98a5-4964-ad80-ee9c3c169e5c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:49.429530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31d32b-98a5-4964-ad80-ee9c3c169e5c None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:49.430851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:49.436047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c2b0c-0451-408c-a8ed-19cc339cadd0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:49.436515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c2b0c-0451-408c-a8ed-19cc339cadd0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:49.436621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c2b0c-0451-408c-a8ed-19cc339cadd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:49.459918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-607c2b0c-0451-408c-a8ed-19cc339cadd0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:49.461129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-607c2b0c-0451-408c-a8ed-19cc339cadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:49.469543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:49.755240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31d32b-98a5-4964-ad80-ee9c3c169e5c None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:49.756965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-df31d32b-98a5-4964-ad80-ee9c3c169e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:49.842202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31d32b-98a5-4964-ad80-ee9c3c169e5c None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:49.846296 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785805f1-3dd5-43dc-a985-2f2754c59c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:49.846964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785805f1-3dd5-43dc-a985-2f2754c59c41 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:49.847236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785805f1-3dd5-43dc-a985-2f2754c59c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:49.847499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785805f1-3dd5-43dc-a985-2f2754c59c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:49.856599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785805f1-3dd5-43dc-a985-2f2754c59c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:49.858034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785805f1-3dd5-43dc-a985-2f2754c59c41 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:49.867918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 778/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:51.855727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1b1b-1318-453a-a902-b8a89199b1cd None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:51.856268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1b1b-1318-453a-a902-b8a89199b1cd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:51.856268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1b1b-1318-453a-a902-b8a89199b1cd None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:51.857616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:51.863149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c45dec-bef4-4b87-b9e2-ca7b12283ada None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:51.863559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c45dec-bef4-4b87-b9e2-ca7b12283ada None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:51.863694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c45dec-bef4-4b87-b9e2-ca7b12283ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:51.884859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-39c45dec-bef4-4b87-b9e2-ca7b12283ada None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:51.886141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-39c45dec-bef4-4b87-b9e2-ca7b12283ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:51.895750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:52.190490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f1b1b-1318-453a-a902-b8a89199b1cd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:52.192232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f69f1b1b-1318-453a-a902-b8a89199b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:52.206180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f1b1b-1318-453a-a902-b8a89199b1cd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:52.210739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11555509-cfa5-4d02-911f-b13560ec2c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:52.211439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555509-cfa5-4d02-911f-b13560ec2c05 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:52.211761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555509-cfa5-4d02-911f-b13560ec2c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:52.212037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555509-cfa5-4d02-911f-b13560ec2c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:52.221994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11555509-cfa5-4d02-911f-b13560ec2c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:52.223512 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11555509-cfa5-4d02-911f-b13560ec2c05 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:52.233112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 754/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:55.847685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a018da8-38d6-4b0e-be52-56dd2b0e0e2d None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:55.848328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a018da8-38d6-4b0e-be52-56dd2b0e0e2d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:55.848328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a018da8-38d6-4b0e-be52-56dd2b0e0e2d None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:55.849619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:55.854811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55249d-b714-4b7f-a60f-296376b55cc7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:55.855246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55249d-b714-4b7f-a60f-296376b55cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:55.855354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55249d-b714-4b7f-a60f-296376b55cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:55.863626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:55.876985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fd55249d-b714-4b7f-a60f-296376b55cc7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:55.878188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fd55249d-b714-4b7f-a60f-296376b55cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:55.886417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:45:56.451736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a018da8-38d6-4b0e-be52-56dd2b0e0e2d None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:56.454173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4a018da8-38d6-4b0e-be52-56dd2b0e0e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:56.533455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a018da8-38d6-4b0e-be52-56dd2b0e0e2d None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:56.537010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22598234-87f0-4327-9aa7-3f01d51aca3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:56.537627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22598234-87f0-4327-9aa7-3f01d51aca3c service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:56.537901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22598234-87f0-4327-9aa7-3f01d51aca3c service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:56.538191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22598234-87f0-4327-9aa7-3f01d51aca3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:56.547561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22598234-87f0-4327-9aa7-3f01d51aca3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:56.548985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22598234-87f0-4327-9aa7-3f01d51aca3c service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:56.558358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 781/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:58.524858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a31a4-5471-4540-ab28-36da1eb14f39 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:58.525432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a31a4-5471-4540-ab28-36da1eb14f39 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:58.525432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a31a4-5471-4540-ab28-36da1eb14f39 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:58.526753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:58.532822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c56d8-d3f5-4e50-b001-457664ba8f59 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:58.533304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c56d8-d3f5-4e50-b001-457664ba8f59 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:58.533419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c56d8-d3f5-4e50-b001-457664ba8f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:58.553128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e56c56d8-d3f5-4e50-b001-457664ba8f59 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:58.554390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e56c56d8-d3f5-4e50-b001-457664ba8f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:58.562260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:59.119490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a31a4-5471-4540-ab28-36da1eb14f39 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:59.121866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-269a31a4-5471-4540-ab28-36da1eb14f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:59.137872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a31a4-5471-4540-ab28-36da1eb14f39 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:59.142201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be075aa7-b6b5-44a8-910f-6b29345d12a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:59.142830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be075aa7-b6b5-44a8-910f-6b29345d12a6 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:59.143117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be075aa7-b6b5-44a8-910f-6b29345d12a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:59.143392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be075aa7-b6b5-44a8-910f-6b29345d12a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:59.152604 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be075aa7-b6b5-44a8-910f-6b29345d12a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:59.154042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be075aa7-b6b5-44a8-910f-6b29345d12a6 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:59.164409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 757/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:08.548300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:09.160060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=8 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:27.571273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665acdc4-c582-4a66-b59f-ba25ee673eb2 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:27.571893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665acdc4-c582-4a66-b59f-ba25ee673eb2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:27.571893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665acdc4-c582-4a66-b59f-ba25ee673eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:27.598288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-665acdc4-c582-4a66-b59f-ba25ee673eb2 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:27.599540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-665acdc4-c582-4a66-b59f-ba25ee673eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:27.613408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 783/1540] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:27.623190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fdb97-00cd-4d06-9640-0fb6e7193b64 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:27.624215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fdb97-00cd-4d06-9640-0fb6e7193b64 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:27.624719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fdb97-00cd-4d06-9640-0fb6e7193b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:27.660080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-049fdb97-00cd-4d06-9640-0fb6e7193b64 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:27.661672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-049fdb97-00cd-4d06-9640-0fb6e7193b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:27.673634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 758/1541] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:27.678204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665acdc4-c582-4a66-b59f-ba25ee673eb2 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:27.693750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665acdc4-c582-4a66-b59f-ba25ee673eb2 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:27.703250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:27.703879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:27.704156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:27.704430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:27.705082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:27.705384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:27.706406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WARNING py.warnings [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:47:27.706406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: warnings.warn(msg) Aug 18 20:47:27.706406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: Aug 18 20:47:27.707330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:27.724407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 784/1542] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:27.733803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fdb97-00cd-4d06-9640-0fb6e7193b64 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:27.744470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fdb97-00cd-4d06-9640-0fb6e7193b64 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:27.760443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243767bb-f11a-4755-b768-672d27b51c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:27.761513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243767bb-f11a-4755-b768-672d27b51c90 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:27.762019 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243767bb-f11a-4755-b768-672d27b51c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:27.762516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243767bb-f11a-4755-b768-672d27b51c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:27.763494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243767bb-f11a-4755-b768-672d27b51c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:27.764757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WARNING py.warnings [None req-243767bb-f11a-4755-b768-672d27b51c90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:47:27.764757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: warnings.warn(msg) Aug 18 20:47:27.764757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: Aug 18 20:47:27.766308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243767bb-f11a-4755-b768-672d27b51c90 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:27.827532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 759/1543] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:27 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:27.832082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:27.846362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce19db-ff6b-4720-92d4-ee620ce0a7cb admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:27.925818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160ca3c-b859-4ade-8dc3-ab209184204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:27.926454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160ca3c-b859-4ade-8dc3-ab209184204a admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:27.926731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160ca3c-b859-4ade-8dc3-ab209184204a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:27.927030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160ca3c-b859-4ade-8dc3-ab209184204a admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:27.927681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160ca3c-b859-4ade-8dc3-ab209184204a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:27.928786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WARNING py.warnings [None req-b160ca3c-b859-4ade-8dc3-ab209184204a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:47:27.928786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: warnings.warn(msg) Aug 18 20:47:27.928786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: Aug 18 20:47:27.929946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160ca3c-b859-4ade-8dc3-ab209184204a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:27.959737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 785/1544] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:27 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:27.964260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243767bb-f11a-4755-b768-672d27b51c90 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:27.980497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243767bb-f11a-4755-b768-672d27b51c90 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:27.991397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310523ef-0032-45b3-b493-f175d94872ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:27.992361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310523ef-0032-45b3-b493-f175d94872ad admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:27.992864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310523ef-0032-45b3-b493-f175d94872ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:27.993334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310523ef-0032-45b3-b493-f175d94872ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:27.994217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310523ef-0032-45b3-b493-f175d94872ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:27.996162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310523ef-0032-45b3-b493-f175d94872ad admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:28.008370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 760/1545] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:28.014136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160ca3c-b859-4ade-8dc3-ab209184204a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:28.029227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160ca3c-b859-4ade-8dc3-ab209184204a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:28.037087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17a740-54fb-4664-af21-709ef11004d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:28.037704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a740-54fb-4664-af21-709ef11004d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.037982 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a740-54fb-4664-af21-709ef11004d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.038255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a740-54fb-4664-af21-709ef11004d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.038928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17a740-54fb-4664-af21-709ef11004d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:28.040540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17a740-54fb-4664-af21-709ef11004d7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:28.061441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 786/1546] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:28.065805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310523ef-0032-45b3-b493-f175d94872ad admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:28.083480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310523ef-0032-45b3-b493-f175d94872ad admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:28.089152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f24ff-2806-4149-bfd7-810effd35967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:28.090300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f24ff-2806-4149-bfd7-810effd35967 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.090817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f24ff-2806-4149-bfd7-810effd35967 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.091308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f24ff-2806-4149-bfd7-810effd35967 admin admin] PATH_INFO: `/v3/projects/85dce823f27e4810944dfbfb4eb152aa/users/c3f6675923024effb505efe9874b1923/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.116882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f24ff-2806-4149-bfd7-810effd35967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85dce823f27e4810944dfbfb4eb152aa, user_id=c3f6675923024effb505efe9874b1923, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:28.118366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WARNING py.warnings [None req-e47f24ff-2806-4149-bfd7-810effd35967 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:47:28.118366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: warnings.warn(msg) Aug 18 20:47:28.118366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: Aug 18 20:47:28.121460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f24ff-2806-4149-bfd7-810effd35967 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:28.146314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 761/1547] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:28 2022] PUT /identity/v3/projects/85dce823f27e4810944dfbfb4eb152aa/users/c3f6675923024effb505efe9874b1923/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:28.167016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee9631-a615-4d61-9b96-5a82cc5679a8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.167457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee9631-a615-4d61-9b96-5a82cc5679a8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.168450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee9631-a615-4d61-9b96-5a82cc5679a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.218011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d8ee9631-a615-4d61-9b96-5a82cc5679a8 None None] MFA Rules not processed for user `c3f6675923024effb505efe9874b1923`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.219284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d8ee9631-a615-4d61-9b96-5a82cc5679a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.237270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c54223-0fd8-43c8-a56c-198b2b5834a2 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.237938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c54223-0fd8-43c8-a56c-198b2b5834a2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.238414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c54223-0fd8-43c8-a56c-198b2b5834a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.278527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-01c54223-0fd8-43c8-a56c-198b2b5834a2 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.280158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-01c54223-0fd8-43c8-a56c-198b2b5834a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.350836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 787/1548] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:28.355344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee9631-a615-4d61-9b96-5a82cc5679a8 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:28.405544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 762/1549] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:47:28.407539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32b16-4950-441c-8593-158ca6ea9694 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.408166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32b16-4950-441c-8593-158ca6ea9694 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.408669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32b16-4950-441c-8593-158ca6ea9694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.451983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2dc32b16-4950-441c-8593-158ca6ea9694 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.453617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2dc32b16-4950-441c-8593-158ca6ea9694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.469047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:28.473822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 763/1550] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:28.475252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ac03-c0ba-48e1-bc1d-af3140e0f3cb None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.475492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ac03-c0ba-48e1-bc1d-af3140e0f3cb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.475977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ac03-c0ba-48e1-bc1d-af3140e0f3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.500167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee9631-a615-4d61-9b96-5a82cc5679a8 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:28.518473 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fbe1f-ea01-4b09-bbb6-73d169d778b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:28.519141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fbe1f-ea01-4b09-bbb6-73d169d778b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.519422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fbe1f-ea01-4b09-bbb6-73d169d778b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.519694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fbe1f-ea01-4b09-bbb6-73d169d778b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.519816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-87e1ac03-c0ba-48e1-bc1d-af3140e0f3cb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.520333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fbe1f-ea01-4b09-bbb6-73d169d778b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:28.521018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-87e1ac03-c0ba-48e1-bc1d-af3140e0f3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.522259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fbe1f-ea01-4b09-bbb6-73d169d778b7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:28.563637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 764/1551] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:28.565017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e9cd-dda5-4e48-b7ff-12c889e9890f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.565300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e9cd-dda5-4e48-b7ff-12c889e9890f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.565573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e9cd-dda5-4e48-b7ff-12c889e9890f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.583635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 788/1552] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/projects => generated 371 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:47:28.584516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fbe1f-ea01-4b09-bbb6-73d169d778b7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:28.616018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b234e9cd-dda5-4e48-b7ff-12c889e9890f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.617252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b234e9cd-dda5-4e48-b7ff-12c889e9890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.709457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fbe1f-ea01-4b09-bbb6-73d169d778b7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:28.719981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e78e4-6565-4e50-9bbf-870651bd8624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:28.720932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e78e4-6565-4e50-9bbf-870651bd8624 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.721217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e78e4-6565-4e50-9bbf-870651bd8624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.721494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e78e4-6565-4e50-9bbf-870651bd8624 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.722905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e78e4-6565-4e50-9bbf-870651bd8624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:28.723220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e78e4-6565-4e50-9bbf-870651bd8624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:28.724988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e78e4-6565-4e50-9bbf-870651bd8624 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:28.741259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 789/1553] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:28.742103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e78e4-6565-4e50-9bbf-870651bd8624 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:28.745319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 765/1554] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:28.747785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fb0f7-350a-46e0-b2cc-cbfc597f046a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.748149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fb0f7-350a-46e0-b2cc-cbfc597f046a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.748504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fb0f7-350a-46e0-b2cc-cbfc597f046a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.760440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e78e4-6565-4e50-9bbf-870651bd8624 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:28.766972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a008e-1dc7-4de6-8b35-deeb5a71d5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:28.767594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a008e-1dc7-4de6-8b35-deeb5a71d5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.767870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a008e-1dc7-4de6-8b35-deeb5a71d5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.768144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a008e-1dc7-4de6-8b35-deeb5a71d5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.768779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a008e-1dc7-4de6-8b35-deeb5a71d5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:28.770831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a008e-1dc7-4de6-8b35-deeb5a71d5e9 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:28.776776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-352fb0f7-350a-46e0-b2cc-cbfc597f046a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.778599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-352fb0f7-350a-46e0-b2cc-cbfc597f046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.790831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 766/1555] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:28.790831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6bd9-bd84-4892-87a1-31b9abdb18a6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.790831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6bd9-bd84-4892-87a1-31b9abdb18a6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.790831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6bd9-bd84-4892-87a1-31b9abdb18a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.800360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 790/1556] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:28.802717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8507-594c-4e38-ad55-907b926374e4 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.803585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8507-594c-4e38-ad55-907b926374e4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.804120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8507-594c-4e38-ad55-907b926374e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.819015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a24d6bd9-bd84-4892-87a1-31b9abdb18a6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.820582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a24d6bd9-bd84-4892-87a1-31b9abdb18a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.827557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ce8c8507-594c-4e38-ad55-907b926374e4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.828747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ce8c8507-594c-4e38-ad55-907b926374e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.830273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 767/1557] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:28.831771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713cd99-837c-4c30-9241-37a8e0c18780 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.832128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713cd99-837c-4c30-9241-37a8e0c18780 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.832635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713cd99-837c-4c30-9241-37a8e0c18780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.843712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:28.847353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 791/1558] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:28.848485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8507-594c-4e38-ad55-907b926374e4 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:28.857886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7713cd99-837c-4c30-9241-37a8e0c18780 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.858959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8507-594c-4e38-ad55-907b926374e4 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:28.859180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7713cd99-837c-4c30-9241-37a8e0c18780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.863635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53374a-2ad7-4d8c-9724-4cc761af2ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:28.864241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53374a-2ad7-4d8c-9724-4cc761af2ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.864523 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53374a-2ad7-4d8c-9724-4cc761af2ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.864795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53374a-2ad7-4d8c-9724-4cc761af2ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.865452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53374a-2ad7-4d8c-9724-4cc761af2ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:28.865744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53374a-2ad7-4d8c-9724-4cc761af2ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:28.866978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 768/1559] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:28.867372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53374a-2ad7-4d8c-9724-4cc761af2ad6 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:28.874582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713cd99-837c-4c30-9241-37a8e0c18780 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:28.884995 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713cd99-837c-4c30-9241-37a8e0c18780 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:28.892597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4766a-bfc8-41cd-b8e8-c20127fb81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:28.893294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 792/1560] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:28.893428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4766a-bfc8-41cd-b8e8-c20127fb81e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.893570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4766a-bfc8-41cd-b8e8-c20127fb81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.893927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4766a-bfc8-41cd-b8e8-c20127fb81e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.894468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2159a0-e426-4649-8187-814878826749 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.894571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4766a-bfc8-41cd-b8e8-c20127fb81e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:28.894753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2159a0-e426-4649-8187-814878826749 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.895053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2159a0-e426-4649-8187-814878826749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.896587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4766a-bfc8-41cd-b8e8-c20127fb81e9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:28.920919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ea2159a0-e426-4649-8187-814878826749 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.922126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ea2159a0-e426-4649-8187-814878826749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.926878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 769/1561] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:28.927904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4766a-bfc8-41cd-b8e8-c20127fb81e9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:28.934877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 793/1562] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:28.936121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e231a-a651-4e89-9f51-23b765dc4b65 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:28.936538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e231a-a651-4e89-9f51-23b765dc4b65 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:28.936964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e231a-a651-4e89-9f51-23b765dc4b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:28.957415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-627e231a-a651-4e89-9f51-23b765dc4b65 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:28.958638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-627e231a-a651-4e89-9f51-23b765dc4b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:28.999428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4766a-bfc8-41cd-b8e8-c20127fb81e9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.004143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fa6a0-0225-4581-a8c0-4fc9564f7cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.004747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa6a0-0225-4581-a8c0-4fc9564f7cfc admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.005026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa6a0-0225-4581-a8c0-4fc9564f7cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.005296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa6a0-0225-4581-a8c0-4fc9564f7cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.005962 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fa6a0-0225-4581-a8c0-4fc9564f7cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.007601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fa6a0-0225-4581-a8c0-4fc9564f7cfc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.018326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 770/1563] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:29.019580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6609e-3793-4e7c-be84-2c7e8fac77d6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.025159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 794/1564] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:29.025334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6609e-3793-4e7c-be84-2c7e8fac77d6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.025334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6609e-3793-4e7c-be84-2c7e8fac77d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.025542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c292cf6-ce01-4c50-972c-8009a95f9771 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.025542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c292cf6-ce01-4c50-972c-8009a95f9771 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.025542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c292cf6-ce01-4c50-972c-8009a95f9771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.043872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8ad6609e-3793-4e7c-be84-2c7e8fac77d6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:29.044168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5c292cf6-ce01-4c50-972c-8009a95f9771 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:29.045340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8ad6609e-3793-4e7c-be84-2c7e8fac77d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:29.045598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5c292cf6-ce01-4c50-972c-8009a95f9771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:29.053441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 771/1565] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:29.053911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 795/1566] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:29.054654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524797a6-7e0b-4de8-89da-dd5ae512c4c0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.054804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c292cf6-ce01-4c50-972c-8009a95f9771 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.054976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524797a6-7e0b-4de8-89da-dd5ae512c4c0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.055242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524797a6-7e0b-4de8-89da-dd5ae512c4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.069241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c292cf6-ce01-4c50-972c-8009a95f9771 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.075409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158e1c1-6fdb-401c-8d55-c745c7c453fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.078070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158e1c1-6fdb-401c-8d55-c745c7c453fe admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.078354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158e1c1-6fdb-401c-8d55-c745c7c453fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.078711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158e1c1-6fdb-401c-8d55-c745c7c453fe admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.079579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158e1c1-6fdb-401c-8d55-c745c7c453fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.080225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-524797a6-7e0b-4de8-89da-dd5ae512c4c0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:29.081466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-524797a6-7e0b-4de8-89da-dd5ae512c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:29.083873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158e1c1-6fdb-401c-8d55-c745c7c453fe admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.094802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 772/1567] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:29.094802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524797a6-7e0b-4de8-89da-dd5ae512c4c0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.100890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524797a6-7e0b-4de8-89da-dd5ae512c4c0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.106707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f34717-b734-41c7-80a4-0ae34a607b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.106925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:29.107034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34717-b734-41c7-80a4-0ae34a607b5f admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.107311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34717-b734-41c7-80a4-0ae34a607b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.107577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34717-b734-41c7-80a4-0ae34a607b5f admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.108196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f34717-b734-41c7-80a4-0ae34a607b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.110117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f34717-b734-41c7-80a4-0ae34a607b5f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.120480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 796/1568] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.121502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158e1c1-6fdb-401c-8d55-c745c7c453fe admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.140566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 773/1569] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.140566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f34717-b734-41c7-80a4-0ae34a607b5f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.148057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f34717-b734-41c7-80a4-0ae34a607b5f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.188151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158e1c1-6fdb-401c-8d55-c745c7c453fe admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.192955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f89c89-85de-40c1-870d-83cb8dc9fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.193679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f89c89-85de-40c1-870d-83cb8dc9fd8f admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.193962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f89c89-85de-40c1-870d-83cb8dc9fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.194239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f89c89-85de-40c1-870d-83cb8dc9fd8f admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.194929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f89c89-85de-40c1-870d-83cb8dc9fd8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:29.195237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f89c89-85de-40c1-870d-83cb8dc9fd8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.196829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f89c89-85de-40c1-870d-83cb8dc9fd8f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.209353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04af37-1a88-4b96-bbe7-5a34188a7088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.209573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 797/1570] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:29.210027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04af37-1a88-4b96-bbe7-5a34188a7088 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.210304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f89c89-85de-40c1-870d-83cb8dc9fd8f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.210429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04af37-1a88-4b96-bbe7-5a34188a7088 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.210721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04af37-1a88-4b96-bbe7-5a34188a7088 admin admin] PATH_INFO: `/v3/projects/b14dbdc08c64423f8e6a311526ace277/users/2b6372a5e789479a9b9c86a577138284/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.220030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f89c89-85de-40c1-870d-83cb8dc9fd8f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.225149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaabdf7-d5d8-44f6-9fa0-c7312bd59882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.225857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaabdf7-d5d8-44f6-9fa0-c7312bd59882 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.226113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaabdf7-d5d8-44f6-9fa0-c7312bd59882 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.226379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaabdf7-d5d8-44f6-9fa0-c7312bd59882 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.226620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04af37-1a88-4b96-bbe7-5a34188a7088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14dbdc08c64423f8e6a311526ace277, user_id=2b6372a5e789479a9b9c86a577138284, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.227056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaabdf7-d5d8-44f6-9fa0-c7312bd59882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:29.227359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaabdf7-d5d8-44f6-9fa0-c7312bd59882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.228930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaabdf7-d5d8-44f6-9fa0-c7312bd59882 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.229311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04af37-1a88-4b96-bbe7-5a34188a7088 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.243426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 798/1571] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:29.247370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 774/1572] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:29 2022] PUT /identity/v3/projects/b14dbdc08c64423f8e6a311526ace277/users/2b6372a5e789479a9b9c86a577138284/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:29.247522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaabdf7-d5d8-44f6-9fa0-c7312bd59882 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.247621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8eb3-8c48-41ac-aa6f-e6bb052ec493 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.247621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8eb3-8c48-41ac-aa6f-e6bb052ec493 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.247621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8eb3-8c48-41ac-aa6f-e6bb052ec493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.262244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaabdf7-d5d8-44f6-9fa0-c7312bd59882 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.266408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-95cf8eb3-8c48-41ac-aa6f-e6bb052ec493 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:29.267634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-95cf8eb3-8c48-41ac-aa6f-e6bb052ec493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:29.284769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:29.322221 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f729ee-5305-4afa-96e3-801a6d75e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.322869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f729ee-5305-4afa-96e3-801a6d75e4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.323152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f729ee-5305-4afa-96e3-801a6d75e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.323429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f729ee-5305-4afa-96e3-801a6d75e4f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.324782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f729ee-5305-4afa-96e3-801a6d75e4f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:29.325082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f729ee-5305-4afa-96e3-801a6d75e4f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.326692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f729ee-5305-4afa-96e3-801a6d75e4f3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.330970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 775/1573] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:29.331829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf8eb3-8c48-41ac-aa6f-e6bb052ec493 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.340690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 799/1574] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:29.340953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf8eb3-8c48-41ac-aa6f-e6bb052ec493 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.341368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f729ee-5305-4afa-96e3-801a6d75e4f3 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.345853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467560-e0f8-4f23-9337-ac884cbce7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.346457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467560-e0f8-4f23-9337-ac884cbce7ca admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.346734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467560-e0f8-4f23-9337-ac884cbce7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.347030 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467560-e0f8-4f23-9337-ac884cbce7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.347683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c467560-e0f8-4f23-9337-ac884cbce7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:29.347982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c467560-e0f8-4f23-9337-ac884cbce7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.349579 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c467560-e0f8-4f23-9337-ac884cbce7ca admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.352572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f729ee-5305-4afa-96e3-801a6d75e4f3 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.358119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5827-5176-44e9-a53a-f4e6d7e3b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.358725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5827-5176-44e9-a53a-f4e6d7e3b018 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.359028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5827-5176-44e9-a53a-f4e6d7e3b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.359301 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5827-5176-44e9-a53a-f4e6d7e3b018 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.359918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b5827-5176-44e9-a53a-f4e6d7e3b018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.361838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b5827-5176-44e9-a53a-f4e6d7e3b018 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.362804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 776/1575] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:29.363245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467560-e0f8-4f23-9337-ac884cbce7ca admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.375030 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467560-e0f8-4f23-9337-ac884cbce7ca admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.380657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8f6be-3dd9-4681-a0ee-b4efda79d60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.381337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8f6be-3dd9-4681-a0ee-b4efda79d60a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.381689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8f6be-3dd9-4681-a0ee-b4efda79d60a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.382049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8f6be-3dd9-4681-a0ee-b4efda79d60a admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.382675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8f6be-3dd9-4681-a0ee-b4efda79d60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.384640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8f6be-3dd9-4681-a0ee-b4efda79d60a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.389606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 800/1576] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.389606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5827-5176-44e9-a53a-f4e6d7e3b018 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.398565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5827-5176-44e9-a53a-f4e6d7e3b018 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.399887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 777/1577] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:29.400850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8f6be-3dd9-4681-a0ee-b4efda79d60a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.406481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac628de-a2a6-47f3-8998-36db402c84af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.407266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac628de-a2a6-47f3-8998-36db402c84af admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.407714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac628de-a2a6-47f3-8998-36db402c84af admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.408042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac628de-a2a6-47f3-8998-36db402c84af admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.408835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac628de-a2a6-47f3-8998-36db402c84af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.410800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac628de-a2a6-47f3-8998-36db402c84af admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.413597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8f6be-3dd9-4681-a0ee-b4efda79d60a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.423694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c1fde-9455-4674-b034-565383d27b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.424482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c1fde-9455-4674-b034-565383d27b8d admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.424767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c1fde-9455-4674-b034-565383d27b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.425070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c1fde-9455-4674-b034-565383d27b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.425778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c1fde-9455-4674-b034-565383d27b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.428039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c1fde-9455-4674-b034-565383d27b8d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.441976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 778/1578] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:29.443062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c1fde-9455-4674-b034-565383d27b8d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.454201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c1fde-9455-4674-b034-565383d27b8d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.454464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 801/1579] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.455675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac628de-a2a6-47f3-8998-36db402c84af admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.490943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:29.513416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251eaa1-b4e4-4b48-a7b3-89c4fc7582e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.513956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251eaa1-b4e4-4b48-a7b3-89c4fc7582e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.514235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251eaa1-b4e4-4b48-a7b3-89c4fc7582e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.514506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251eaa1-b4e4-4b48-a7b3-89c4fc7582e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.515164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251eaa1-b4e4-4b48-a7b3-89c4fc7582e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.517093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251eaa1-b4e4-4b48-a7b3-89c4fc7582e3 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.521646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac628de-a2a6-47f3-8998-36db402c84af admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.526872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb06d46-5650-4c76-92bf-83f61a76763f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.527661 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06d46-5650-4c76-92bf-83f61a76763f admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.528031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06d46-5650-4c76-92bf-83f61a76763f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.528334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06d46-5650-4c76-92bf-83f61a76763f admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.528973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb06d46-5650-4c76-92bf-83f61a76763f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:29.529281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb06d46-5650-4c76-92bf-83f61a76763f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.530925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb06d46-5650-4c76-92bf-83f61a76763f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.552063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 802/1580] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:29.552063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb06d46-5650-4c76-92bf-83f61a76763f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.552379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 779/1581] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.552499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251eaa1-b4e4-4b48-a7b3-89c4fc7582e3 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.556535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb06d46-5650-4c76-92bf-83f61a76763f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.615881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a757fe-69b7-4761-a74e-4fc985bdfe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.616568 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a757fe-69b7-4761-a74e-4fc985bdfe42 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.616757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a757fe-69b7-4761-a74e-4fc985bdfe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.617031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a757fe-69b7-4761-a74e-4fc985bdfe42 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.617656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a757fe-69b7-4761-a74e-4fc985bdfe42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.619637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a757fe-69b7-4761-a74e-4fc985bdfe42 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.619767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251eaa1-b4e4-4b48-a7b3-89c4fc7582e3 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.625426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669652e4-e2db-4d2e-b2f9-58e2c970892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.626425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669652e4-e2db-4d2e-b2f9-58e2c970892c admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.626702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669652e4-e2db-4d2e-b2f9-58e2c970892c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.627004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669652e4-e2db-4d2e-b2f9-58e2c970892c admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.627626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669652e4-e2db-4d2e-b2f9-58e2c970892c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.629558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669652e4-e2db-4d2e-b2f9-58e2c970892c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.648125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 803/1582] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.648125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a757fe-69b7-4761-a74e-4fc985bdfe42 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.651901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:29.661028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 780/1583] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.662169 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669652e4-e2db-4d2e-b2f9-58e2c970892c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.715467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a757fe-69b7-4761-a74e-4fc985bdfe42 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.727785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669652e4-e2db-4d2e-b2f9-58e2c970892c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.732620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b30ca9-1578-4272-b850-823eaf6c5203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.733224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b30ca9-1578-4272-b850-823eaf6c5203 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.733499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b30ca9-1578-4272-b850-823eaf6c5203 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.733776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b30ca9-1578-4272-b850-823eaf6c5203 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.734411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b30ca9-1578-4272-b850-823eaf6c5203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.736039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b30ca9-1578-4272-b850-823eaf6c5203 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.747537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 781/1584] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:29.748386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b30ca9-1578-4272-b850-823eaf6c5203 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.757907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b30ca9-1578-4272-b850-823eaf6c5203 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.763065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9ca41-10e3-433f-a5f4-c30d0a393fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.763958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9ca41-10e3-433f-a5f4-c30d0a393fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.764131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9ca41-10e3-433f-a5f4-c30d0a393fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.764408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9ca41-10e3-433f-a5f4-c30d0a393fb7 admin admin] PATH_INFO: `/v3/projects/b14dbdc08c64423f8e6a311526ace277/users/2b6372a5e789479a9b9c86a577138284/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.766355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9ca41-10e3-433f-a5f4-c30d0a393fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14dbdc08c64423f8e6a311526ace277, user_id=2b6372a5e789479a9b9c86a577138284, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.769040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9ca41-10e3-433f-a5f4-c30d0a393fb7 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.771711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:29.780345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 782/1585] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:29 2022] PUT /identity/v3/projects/b14dbdc08c64423f8e6a311526ace277/users/2b6372a5e789479a9b9c86a577138284/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:29.781139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9ca41-10e3-433f-a5f4-c30d0a393fb7 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.784954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8ca47-aa0e-42be-9096-c40547853818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.785622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8ca47-aa0e-42be-9096-c40547853818 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.785929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8ca47-aa0e-42be-9096-c40547853818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.786203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8ca47-aa0e-42be-9096-c40547853818 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.786882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8ca47-aa0e-42be-9096-c40547853818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.788494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8ca47-aa0e-42be-9096-c40547853818 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.807149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 804/1586] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:29.807149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8ca47-aa0e-42be-9096-c40547853818 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.816106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8ca47-aa0e-42be-9096-c40547853818 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.852485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9ca41-10e3-433f-a5f4-c30d0a393fb7 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.857271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5543a-feb8-476f-b2f3-91e69c87266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.857930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5543a-feb8-476f-b2f3-91e69c87266e admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.858208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5543a-feb8-476f-b2f3-91e69c87266e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.858473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5543a-feb8-476f-b2f3-91e69c87266e admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.859111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5543a-feb8-476f-b2f3-91e69c87266e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.861029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5543a-feb8-476f-b2f3-91e69c87266e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.872646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88335c25-39cd-4e72-888b-3d4fee2228eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.873510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88335c25-39cd-4e72-888b-3d4fee2228eb admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.873743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88335c25-39cd-4e72-888b-3d4fee2228eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.874020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88335c25-39cd-4e72-888b-3d4fee2228eb admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.874689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88335c25-39cd-4e72-888b-3d4fee2228eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.876688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88335c25-39cd-4e72-888b-3d4fee2228eb admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.889236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 783/1587] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.890100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5543a-feb8-476f-b2f3-91e69c87266e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.900590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5543a-feb8-476f-b2f3-91e69c87266e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.905458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78ad6e-559f-4954-96f1-aceb451155c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.906068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ad6e-559f-4954-96f1-aceb451155c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.906348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ad6e-559f-4954-96f1-aceb451155c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.906622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ad6e-559f-4954-96f1-aceb451155c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.906744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 805/1588] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.907277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78ad6e-559f-4954-96f1-aceb451155c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.907574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88335c25-39cd-4e72-888b-3d4fee2228eb admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.909196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78ad6e-559f-4954-96f1-aceb451155c4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.917676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88335c25-39cd-4e72-888b-3d4fee2228eb admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.922214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ea96-8835-4897-9972-07e67d3a2032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:29.922838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ea96-8835-4897-9972-07e67d3a2032 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:29.923115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ea96-8835-4897-9972-07e67d3a2032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:29.923380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ea96-8835-4897-9972-07e67d3a2032 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:29.923995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55ea96-8835-4897-9972-07e67d3a2032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:29.925903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55ea96-8835-4897-9972-07e67d3a2032 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:29.939074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 784/1589] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.939882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78ad6e-559f-4954-96f1-aceb451155c4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.948692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 806/1590] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/users => generated 302 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:29.950275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ea96-8835-4897-9972-07e67d3a2032 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:29.960038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ea96-8835-4897-9972-07e67d3a2032 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:29.993099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:30.007417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78ad6e-559f-4954-96f1-aceb451155c4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.013211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f0315-e441-4419-a966-e7f528a71e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.013820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0315-e441-4419-a966-e7f528a71e5c admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.014176 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0315-e441-4419-a966-e7f528a71e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.014399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0315-e441-4419-a966-e7f528a71e5c admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.015066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f0315-e441-4419-a966-e7f528a71e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.017057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f0315-e441-4419-a966-e7f528a71e5c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.021256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec157778-efa5-4b3f-9eef-a1160a5048b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.021928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec157778-efa5-4b3f-9eef-a1160a5048b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.022209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec157778-efa5-4b3f-9eef-a1160a5048b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.022484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec157778-efa5-4b3f-9eef-a1160a5048b4 admin admin] PATH_INFO: `/v3/projects/afe9b93cc4be499d8c794274ff38f65c/users/f3d50a4d32b0479da61ccd26ff894197/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.039307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec157778-efa5-4b3f-9eef-a1160a5048b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe9b93cc4be499d8c794274ff38f65c, user_id=f3d50a4d32b0479da61ccd26ff894197, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.041203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 785/1591] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:29 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:30.042465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9038776-ce41-44fd-a40a-3fe9cba56934 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.042803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9038776-ce41-44fd-a40a-3fe9cba56934 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.043217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9038776-ce41-44fd-a40a-3fe9cba56934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.045450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec157778-efa5-4b3f-9eef-a1160a5048b4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.059432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 807/1592] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:29 2022] PUT /identity/v3/projects/afe9b93cc4be499d8c794274ff38f65c/users/f3d50a4d32b0479da61ccd26ff894197/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:30.063893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec157778-efa5-4b3f-9eef-a1160a5048b4 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.071379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e9038776-ce41-44fd-a40a-3fe9cba56934 None None] MFA Rules not processed for user `2b6372a5e789479a9b9c86a577138284`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:30.072614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e9038776-ce41-44fd-a40a-3fe9cba56934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:30.115547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:30.130787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec157778-efa5-4b3f-9eef-a1160a5048b4 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.135602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52538-a932-44fc-8ce1-d08da0ad07bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.136203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52538-a932-44fc-8ce1-d08da0ad07bd admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.136972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52538-a932-44fc-8ce1-d08da0ad07bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.137237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52538-a932-44fc-8ce1-d08da0ad07bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.137907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda52538-a932-44fc-8ce1-d08da0ad07bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.139536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda52538-a932-44fc-8ce1-d08da0ad07bd admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.144521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 786/1593] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:30.145367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9038776-ce41-44fd-a40a-3fe9cba56934 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.158821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 808/1594] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.158821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52538-a932-44fc-8ce1-d08da0ad07bd admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.162187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9038776-ce41-44fd-a40a-3fe9cba56934 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.166667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a4074-8e19-4c97-b76d-c8436bdf4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.166938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52538-a932-44fc-8ce1-d08da0ad07bd admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.167370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a4074-8e19-4c97-b76d-c8436bdf4aee admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.167645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a4074-8e19-4c97-b76d-c8436bdf4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.167919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a4074-8e19-4c97-b76d-c8436bdf4aee admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.168714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a4074-8e19-4c97-b76d-c8436bdf4aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.170219 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a4074-8e19-4c97-b76d-c8436bdf4aee admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.171662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c2ab4-68da-4bc4-bb05-8cebd912f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.172242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2ab4-68da-4bc4-bb05-8cebd912f8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.172528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2ab4-68da-4bc4-bb05-8cebd912f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.172798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2ab4-68da-4bc4-bb05-8cebd912f8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.173541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2ab4-68da-4bc4-bb05-8cebd912f8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.175156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2ab4-68da-4bc4-bb05-8cebd912f8d7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.181619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 787/1595] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.182631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a4074-8e19-4c97-b76d-c8436bdf4aee admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.190064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 809/1596] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.190064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c2ab4-68da-4bc4-bb05-8cebd912f8d7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.193636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a4074-8e19-4c97-b76d-c8436bdf4aee admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.198235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6003b69-92f0-4793-baa2-96565891a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.199421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6003b69-92f0-4793-baa2-96565891a256 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.199556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c2ab4-68da-4bc4-bb05-8cebd912f8d7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.199716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6003b69-92f0-4793-baa2-96565891a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.199972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6003b69-92f0-4793-baa2-96565891a256 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.200621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6003b69-92f0-4793-baa2-96565891a256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.202617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6003b69-92f0-4793-baa2-96565891a256 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.204309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7df86-c306-4037-9e18-375cedf6a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.204972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7df86-c306-4037-9e18-375cedf6a52c admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.205178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7df86-c306-4037-9e18-375cedf6a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.205450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7df86-c306-4037-9e18-375cedf6a52c admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.206076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7df86-c306-4037-9e18-375cedf6a52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.207676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7df86-c306-4037-9e18-375cedf6a52c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.219686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 810/1597] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.220269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7df86-c306-4037-9e18-375cedf6a52c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.224252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 788/1598] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:30 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:30.226015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1a79-a48d-48bd-bf63-5fe59271f5ad None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.226946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1a79-a48d-48bd-bf63-5fe59271f5ad None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.227935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1a79-a48d-48bd-bf63-5fe59271f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.231210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7df86-c306-4037-9e18-375cedf6a52c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.236342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70ac2d-f274-424d-9ca8-358519296cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.236953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70ac2d-f274-424d-9ca8-358519296cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.237225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70ac2d-f274-424d-9ca8-358519296cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.237495 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70ac2d-f274-424d-9ca8-358519296cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.238133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70ac2d-f274-424d-9ca8-358519296cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.239750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70ac2d-f274-424d-9ca8-358519296cd0 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.250723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 811/1599] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.251485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d05a1a79-a48d-48bd-bf63-5fe59271f5ad None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:30.251657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70ac2d-f274-424d-9ca8-358519296cd0 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.253218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d05a1a79-a48d-48bd-bf63-5fe59271f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:30.261280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 789/1600] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:30.262842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a1a79-a48d-48bd-bf63-5fe59271f5ad None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.273916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a1a79-a48d-48bd-bf63-5fe59271f5ad None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.280608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf3178-2ba5-474a-87ca-a6f437eecaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.281276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf3178-2ba5-474a-87ca-a6f437eecaaa admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.281554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf3178-2ba5-474a-87ca-a6f437eecaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.281826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf3178-2ba5-474a-87ca-a6f437eecaaa admin admin] PATH_INFO: `/v3/projects/34a01aa218f742d488e483e433d5d6f6/users/f815bcdc19494ddba3f35ecacf70d6ee/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.298202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf3178-2ba5-474a-87ca-a6f437eecaaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a01aa218f742d488e483e433d5d6f6, user_id=f815bcdc19494ddba3f35ecacf70d6ee, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.300913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf3178-2ba5-474a-87ca-a6f437eecaaa admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.314916 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70ac2d-f274-424d-9ca8-358519296cd0 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.315124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 790/1601] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:30 2022] PUT /identity/v3/projects/34a01aa218f742d488e483e433d5d6f6/users/f815bcdc19494ddba3f35ecacf70d6ee/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:30.315933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf3178-2ba5-474a-87ca-a6f437eecaaa admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.373687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaf2a1-23eb-4690-9430-635a1f7e6780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.374300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaf2a1-23eb-4690-9430-635a1f7e6780 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.374577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaf2a1-23eb-4690-9430-635a1f7e6780 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.374878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaf2a1-23eb-4690-9430-635a1f7e6780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.386294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf3178-2ba5-474a-87ca-a6f437eecaaa admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.391217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2aca-5dc0-4453-bc7a-b29b8661e3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.391826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2aca-5dc0-4453-bc7a-b29b8661e3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.392108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2aca-5dc0-4453-bc7a-b29b8661e3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.392383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2aca-5dc0-4453-bc7a-b29b8661e3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.393031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf2aca-5dc0-4453-bc7a-b29b8661e3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.394643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf2aca-5dc0-4453-bc7a-b29b8661e3e4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.400065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:30.407009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 791/1602] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.407918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2aca-5dc0-4453-bc7a-b29b8661e3e4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.419524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2aca-5dc0-4453-bc7a-b29b8661e3e4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.424429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f102e7-0717-427e-b820-06b86a371f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.425022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f102e7-0717-427e-b820-06b86a371f13 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.425312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f102e7-0717-427e-b820-06b86a371f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.425580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f102e7-0717-427e-b820-06b86a371f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.426367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f102e7-0717-427e-b820-06b86a371f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.427988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f102e7-0717-427e-b820-06b86a371f13 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.438677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 792/1603] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.439626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f102e7-0717-427e-b820-06b86a371f13 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.445485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaf2a1-23eb-4690-9430-635a1f7e6780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.447040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaf2a1-23eb-4690-9430-635a1f7e6780 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.450377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f102e7-0717-427e-b820-06b86a371f13 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.455409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88f755-6e42-4b02-955d-99488eae8207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.456002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88f755-6e42-4b02-955d-99488eae8207 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.456286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88f755-6e42-4b02-955d-99488eae8207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.456565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88f755-6e42-4b02-955d-99488eae8207 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.457212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88f755-6e42-4b02-955d-99488eae8207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.458854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88f755-6e42-4b02-955d-99488eae8207 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.464974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 812/1604] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:30.466514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaf2a1-23eb-4690-9430-635a1f7e6780 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.471619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 793/1605] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.475636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88f755-6e42-4b02-955d-99488eae8207 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.481722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaf2a1-23eb-4690-9430-635a1f7e6780 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.487636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88f755-6e42-4b02-955d-99488eae8207 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.487850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c58bd8-5bc9-4e2d-ab04-569d5d2a6674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.488854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c58bd8-5bc9-4e2d-ab04-569d5d2a6674 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.489351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c58bd8-5bc9-4e2d-ab04-569d5d2a6674 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.489875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c58bd8-5bc9-4e2d-ab04-569d5d2a6674 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.491125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c58bd8-5bc9-4e2d-ab04-569d5d2a6674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.492755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a586ec1-088a-4ebf-9771-93b2f14a58e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.493282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c58bd8-5bc9-4e2d-ab04-569d5d2a6674 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.493468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586ec1-088a-4ebf-9771-93b2f14a58e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.493614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586ec1-088a-4ebf-9771-93b2f14a58e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.493885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586ec1-088a-4ebf-9771-93b2f14a58e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.494523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a586ec1-088a-4ebf-9771-93b2f14a58e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.497251 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a586ec1-088a-4ebf-9771-93b2f14a58e5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.512142 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 813/1606] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.513762 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c58bd8-5bc9-4e2d-ab04-569d5d2a6674 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.522015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 794/1607] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.522015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8d404-dedf-4597-8f40-59fa11834bdd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.522015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8d404-dedf-4597-8f40-59fa11834bdd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.522015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8d404-dedf-4597-8f40-59fa11834bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.531958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:30.553052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ead8d404-dedf-4597-8f40-59fa11834bdd None None] MFA Rules not processed for user `f815bcdc19494ddba3f35ecacf70d6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:30.554322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ead8d404-dedf-4597-8f40-59fa11834bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:30.602847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c58bd8-5bc9-4e2d-ab04-569d5d2a6674 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.608192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a396be-06bf-4679-9d3b-4bf87086e6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.608966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a396be-06bf-4679-9d3b-4bf87086e6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.609241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a396be-06bf-4679-9d3b-4bf87086e6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.609511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a396be-06bf-4679-9d3b-4bf87086e6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.620306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a396be-06bf-4679-9d3b-4bf87086e6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.622202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a396be-06bf-4679-9d3b-4bf87086e6f9 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.632293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 814/1608] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:30.633170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a396be-06bf-4679-9d3b-4bf87086e6f9 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.641914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 795/1609] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:30.642799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8d404-dedf-4597-8f40-59fa11834bdd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.644027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a396be-06bf-4679-9d3b-4bf87086e6f9 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.655031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c36f-bdb6-4d06-9c6c-1fee8a42cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.655804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c36f-bdb6-4d06-9c6c-1fee8a42cb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.656171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c36f-bdb6-4d06-9c6c-1fee8a42cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.656523 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c36f-bdb6-4d06-9c6c-1fee8a42cb73 admin admin] PATH_INFO: `/v3/projects/58bac4a48cbf4e6d877b7617aa0f3c92/users/352a102f604048138df5a31bab4f8cc9/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.666063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8d404-dedf-4597-8f40-59fa11834bdd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.675034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c36f-bdb6-4d06-9c6c-1fee8a42cb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bac4a48cbf4e6d877b7617aa0f3c92, user_id=352a102f604048138df5a31bab4f8cc9, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.677336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3014b7-2214-463b-9e58-f8c19b6e9676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.678167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3014b7-2214-463b-9e58-f8c19b6e9676 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.678500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3014b7-2214-463b-9e58-f8c19b6e9676 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.678786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3014b7-2214-463b-9e58-f8c19b6e9676 admin admin] PATH_INFO: `/v3/projects/7e507634340d4ea6b0c6816855e6b0b1/users/25602770c6774c76b07e4e8dd01be913/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.679908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c36f-bdb6-4d06-9c6c-1fee8a42cb73 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.696457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3014b7-2214-463b-9e58-f8c19b6e9676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e507634340d4ea6b0c6816855e6b0b1, user_id=25602770c6774c76b07e4e8dd01be913, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.699941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3014b7-2214-463b-9e58-f8c19b6e9676 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.700710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 815/1610] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:30 2022] PUT /identity/v3/projects/58bac4a48cbf4e6d877b7617aa0f3c92/users/352a102f604048138df5a31bab4f8cc9/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:30.701667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c36f-bdb6-4d06-9c6c-1fee8a42cb73 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.717040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 796/1611] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:30 2022] PUT /identity/v3/projects/7e507634340d4ea6b0c6816855e6b0b1/users/25602770c6774c76b07e4e8dd01be913/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:30.718540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3014b7-2214-463b-9e58-f8c19b6e9676 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.795990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3014b7-2214-463b-9e58-f8c19b6e9676 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.801536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da239808-dff2-4431-a72a-5c5e706717fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.802161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da239808-dff2-4431-a72a-5c5e706717fc admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.802442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da239808-dff2-4431-a72a-5c5e706717fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.803000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da239808-dff2-4431-a72a-5c5e706717fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.803386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da239808-dff2-4431-a72a-5c5e706717fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.805167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c36f-bdb6-4d06-9c6c-1fee8a42cb73 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.805394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da239808-dff2-4431-a72a-5c5e706717fc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.810992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a12d8d-c5c4-4048-9f17-e385d30c3788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.812018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a12d8d-c5c4-4048-9f17-e385d30c3788 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.812367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a12d8d-c5c4-4048-9f17-e385d30c3788 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.812710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a12d8d-c5c4-4048-9f17-e385d30c3788 admin admin] PATH_INFO: `/v3/projects/f240af4fa4f24cd7812e5c71785fddc8/users/4c15efe9dbba4c57be0e3b14b3357a46/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.819536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 797/1612] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:30.819536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da239808-dff2-4431-a72a-5c5e706717fc admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.840985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da239808-dff2-4431-a72a-5c5e706717fc admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.841945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a12d8d-c5c4-4048-9f17-e385d30c3788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f240af4fa4f24cd7812e5c71785fddc8, user_id=4c15efe9dbba4c57be0e3b14b3357a46, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.847914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad0039-c490-45b6-b341-1917e9fc90e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:30.848732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad0039-c490-45b6-b341-1917e9fc90e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.849358 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad0039-c490-45b6-b341-1917e9fc90e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.849594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad0039-c490-45b6-b341-1917e9fc90e5 admin admin] PATH_INFO: `/v3/projects/4d453e76f81247b7be347cea35241fd0/users/9b05728af02a443e9da7763664096d76/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.851826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a12d8d-c5c4-4048-9f17-e385d30c3788 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.874170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad0039-c490-45b6-b341-1917e9fc90e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d453e76f81247b7be347cea35241fd0, user_id=9b05728af02a443e9da7763664096d76, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:30.877272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad0039-c490-45b6-b341-1917e9fc90e5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:30.878949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 816/1613] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:30 2022] PUT /identity/v3/projects/f240af4fa4f24cd7812e5c71785fddc8/users/4c15efe9dbba4c57be0e3b14b3357a46/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:30.880194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a12d8d-c5c4-4048-9f17-e385d30c3788 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:30.901369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 798/1614] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:30 2022] PUT /identity/v3/projects/4d453e76f81247b7be347cea35241fd0/users/9b05728af02a443e9da7763664096d76/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:30.913755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3c83-0307-4437-97c6-fe925660c209 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:30.914350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3c83-0307-4437-97c6-fe925660c209 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:30.917783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3c83-0307-4437-97c6-fe925660c209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:30.928205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:30.942816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2b1d3c83-0307-4437-97c6-fe925660c209 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:30.944511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2b1d3c83-0307-4437-97c6-fe925660c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:30.977466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a12d8d-c5c4-4048-9f17-e385d30c3788 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:30.994316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:31.032717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 799/1615] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:31.032717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad0413-db8e-418c-bc33-26e2f5324527 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.032717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad0413-db8e-418c-bc33-26e2f5324527 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.033084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad0413-db8e-418c-bc33-26e2f5324527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.064013 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f3ad0413-db8e-418c-bc33-26e2f5324527 None None] MFA Rules not processed for user `25602770c6774c76b07e4e8dd01be913`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:31.065252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f3ad0413-db8e-418c-bc33-26e2f5324527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:31.071120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4d541-6519-45cc-abe4-9edbea4e9128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:31.072085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4d541-6519-45cc-abe4-9edbea4e9128 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.072821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4d541-6519-45cc-abe4-9edbea4e9128 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.073327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4d541-6519-45cc-abe4-9edbea4e9128 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.074375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4d541-6519-45cc-abe4-9edbea4e9128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:31.076907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4d541-6519-45cc-abe4-9edbea4e9128 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:31.114222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 817/1616] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:30 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:31.114222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4d541-6519-45cc-abe4-9edbea4e9128 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:31.156980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 800/1617] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:31.158448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b60f5-3076-4fbc-a51b-860b6aefc078 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.158740 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b60f5-3076-4fbc-a51b-860b6aefc078 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.159195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b60f5-3076-4fbc-a51b-860b6aefc078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.205153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-141b60f5-3076-4fbc-a51b-860b6aefc078 None None] MFA Rules not processed for user `4c15efe9dbba4c57be0e3b14b3357a46`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:31.206670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-141b60f5-3076-4fbc-a51b-860b6aefc078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:31.207283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4d541-6519-45cc-abe4-9edbea4e9128 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:31.213657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21aa86c-d319-47dc-97db-23ecd4bf77c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:31.215430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa86c-d319-47dc-97db-23ecd4bf77c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.216001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa86c-d319-47dc-97db-23ecd4bf77c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.216541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa86c-d319-47dc-97db-23ecd4bf77c9 admin admin] PATH_INFO: `/v3/projects/e59d418003f246b484b97189069c1fb6/users/5d210b7348594c3da477a1b6b77dfb34/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.237490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21aa86c-d319-47dc-97db-23ecd4bf77c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59d418003f246b484b97189069c1fb6, user_id=5d210b7348594c3da477a1b6b77dfb34, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:31.240519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21aa86c-d319-47dc-97db-23ecd4bf77c9 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:31.260423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 818/1618] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:31 2022] PUT /identity/v3/projects/e59d418003f246b484b97189069c1fb6/users/5d210b7348594c3da477a1b6b77dfb34/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:31.262552 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c602-40a8-4fb2-8c48-954ba8d36e3f None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.262968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c602-40a8-4fb2-8c48-954ba8d36e3f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.263390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c602-40a8-4fb2-8c48-954ba8d36e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.286486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 801/1619] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:31.287278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b60f5-3076-4fbc-a51b-860b6aefc078 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:31.299936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8018c602-40a8-4fb2-8c48-954ba8d36e3f None None] MFA Rules not processed for user `9b05728af02a443e9da7763664096d76`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:31.301863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8018c602-40a8-4fb2-8c48-954ba8d36e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:31.315111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:31.354152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b60f5-3076-4fbc-a51b-860b6aefc078 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:31.380615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 819/1620] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:31.385471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018c602-40a8-4fb2-8c48-954ba8d36e3f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:31.400662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:31.419947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278852c-3018-4405-b4cc-f439b1b17923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:31.420706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278852c-3018-4405-b4cc-f439b1b17923 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.421053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278852c-3018-4405-b4cc-f439b1b17923 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.421390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278852c-3018-4405-b4cc-f439b1b17923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.485374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018c602-40a8-4fb2-8c48-954ba8d36e3f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:31.490288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:31.491223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.491352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.491723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] PATH_INFO: `/v3/users/c3f6675923024effb505efe9874b1923` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.492849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f6675923024effb505efe9874b1923)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:31.494798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:31.510938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278852c-3018-4405-b4cc-f439b1b17923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:31.515124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278852c-3018-4405-b4cc-f439b1b17923 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:31.533730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 802/1621] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:31.534789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278852c-3018-4405-b4cc-f439b1b17923 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:31.547408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278852c-3018-4405-b4cc-f439b1b17923 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:31.553174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be01f7-944f-40ca-81e2-e8a8908f71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:31.553925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be01f7-944f-40ca-81e2-e8a8908f71c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.554554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be01f7-944f-40ca-81e2-e8a8908f71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.554867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be01f7-944f-40ca-81e2-e8a8908f71c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.559664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be01f7-944f-40ca-81e2-e8a8908f71c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:31.562090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be01f7-944f-40ca-81e2-e8a8908f71c6 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:31.581021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f6675923024effb505efe9874b1923'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:31.582289 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f6675923024effb505efe9874b1923'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:31.604995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f6675923024effb505efe9874b1923'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:31.609438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 803/1622] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:31 2022] POST /identity/v3/users => generated 298 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:31.610927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f4e9-2bb8-429c-8c81-be8f5145b05f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.611228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f4e9-2bb8-429c-8c81-be8f5145b05f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.611612 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f4e9-2bb8-429c-8c81-be8f5145b05f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.613070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 804/1623] 10.222.0.65 () {54 vars in 962 bytes} [Thu Aug 18 20:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:31.617516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f6675923024effb505efe9874b1923'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:31.618385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea70e1-e1cb-4779-b9e8-4e7ac16d5683 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.618690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea70e1-e1cb-4779-b9e8-4e7ac16d5683 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.618857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f6675923024effb505efe9874b1923'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:31.618977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea70e1-e1cb-4779-b9e8-4e7ac16d5683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.638376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 820/1624] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:31 2022] DELETE /identity/v3/users/c3f6675923024effb505efe9874b1923 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:31.640099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:31.641706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:31.666880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4eea70e1-e1cb-4779-b9e8-4e7ac16d5683 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:31.669609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4eea70e1-e1cb-4779-b9e8-4e7ac16d5683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:31.728254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a30f4-6657-4f27-b9d7-68583d266e10 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:31.734492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9dbe1-d077-4754-aeec-afa7183d307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:31.735840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9dbe1-d077-4754-aeec-afa7183d307c admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.736409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9dbe1-d077-4754-aeec-afa7183d307c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.736891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9dbe1-d077-4754-aeec-afa7183d307c admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.737643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9dbe1-d077-4754-aeec-afa7183d307c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:31.739722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9dbe1-d077-4754-aeec-afa7183d307c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:31.782458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 821/1625] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:31 2022] POST /identity/v3/projects => generated 405 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:31.783817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3c34-9fb2-4f90-90ee-df5c41764f41 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.784108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3c34-9fb2-4f90-90ee-df5c41764f41 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.784385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3c34-9fb2-4f90-90ee-df5c41764f41 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.786472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 822/1626] 10.222.0.65 () {54 vars in 962 bytes} [Thu Aug 18 20:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:31.787347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3c34-9fb2-4f90-90ee-df5c41764f41 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:31.789850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e7ff3c34-9fb2-4f90-90ee-df5c41764f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:31.813229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 805/1627] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:31.814652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cf9d8-42f5-43ee-acee-b837e19f0834 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.814969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cf9d8-42f5-43ee-acee-b837e19f0834 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.815237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cf9d8-42f5-43ee-acee-b837e19f0834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.848879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:31.858675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:31.867946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7c7cf9d8-42f5-43ee-acee-b837e19f0834 None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:31.870509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7c7cf9d8-42f5-43ee-acee-b837e19f0834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:31.939262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3c34-9fb2-4f90-90ee-df5c41764f41 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:31.945880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc1779-7858-4b0e-a478-e4501b6143af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:31.946516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc1779-7858-4b0e-a478-e4501b6143af admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.946822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc1779-7858-4b0e-a478-e4501b6143af admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.947099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc1779-7858-4b0e-a478-e4501b6143af admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:31.947758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc1779-7858-4b0e-a478-e4501b6143af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:31.949931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc1779-7858-4b0e-a478-e4501b6143af admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:31.979956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 823/1628] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:31.981222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4ce8f-23c7-4a4e-80c3-c8fdfbf9b995 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:31.981782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4ce8f-23c7-4a4e-80c3-c8fdfbf9b995 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:31.992640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4ce8f-23c7-4a4e-80c3-c8fdfbf9b995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.009234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 806/1629] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Aug 18 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:32.010280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cf9d8-42f5-43ee-acee-b837e19f0834 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.025692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-88c4ce8f-23c7-4a4e-80c3-c8fdfbf9b995 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:32.030820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-88c4ce8f-23c7-4a4e-80c3-c8fdfbf9b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:32.041073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cf9d8-42f5-43ee-acee-b837e19f0834 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.054240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca2b29-718f-4945-99f8-d03d8c02aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.054240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca2b29-718f-4945-99f8-d03d8c02aeab admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.054240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca2b29-718f-4945-99f8-d03d8c02aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.054240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca2b29-718f-4945-99f8-d03d8c02aeab admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.054567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca2b29-718f-4945-99f8-d03d8c02aeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.054642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 824/1630] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:32.055277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa404ef-f4be-4892-908a-e8f619555de3 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.055955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa404ef-f4be-4892-908a-e8f619555de3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.056058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa404ef-f4be-4892-908a-e8f619555de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.059733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca2b29-718f-4945-99f8-d03d8c02aeab admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.087015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0fa404ef-f4be-4892-908a-e8f619555de3 None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:32.088382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0fa404ef-f4be-4892-908a-e8f619555de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:32.098180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 807/1631] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:32 2022] POST /identity/v3/users => generated 309 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:32.099889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 825/1632] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Aug 18 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:32.100821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa404ef-f4be-4892-908a-e8f619555de3 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.109005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca2b29-718f-4945-99f8-d03d8c02aeab admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.111946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b7ca2b29-718f-4945-99f8-d03d8c02aeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:32.114541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa404ef-f4be-4892-908a-e8f619555de3 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.122357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f595ae-261b-44e8-8a97-0fe11a1e69e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.123087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f595ae-261b-44e8-8a97-0fe11a1e69e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.123456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f595ae-261b-44e8-8a97-0fe11a1e69e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.123743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f595ae-261b-44e8-8a97-0fe11a1e69e7 admin admin] PATH_INFO: `/v3/projects/1c6c4e83c69449059a7dc3297e7dd1a3/users/436431598a424c88ace0fe8ba7e0309b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.144879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f595ae-261b-44e8-8a97-0fe11a1e69e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6c4e83c69449059a7dc3297e7dd1a3, user_id=436431598a424c88ace0fe8ba7e0309b, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.149094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f595ae-261b-44e8-8a97-0fe11a1e69e7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.170917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 826/1633] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:32 2022] PUT /identity/v3/projects/1c6c4e83c69449059a7dc3297e7dd1a3/users/436431598a424c88ace0fe8ba7e0309b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:32.172270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f595ae-261b-44e8-8a97-0fe11a1e69e7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.189236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca2b29-718f-4945-99f8-d03d8c02aeab admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.262053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0d90-7fb1-4300-985e-6a0fdbb0799e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.263271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0d90-7fb1-4300-985e-6a0fdbb0799e service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.263424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0d90-7fb1-4300-985e-6a0fdbb0799e service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.263651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0d90-7fb1-4300-985e-6a0fdbb0799e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.310240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f595ae-261b-44e8-8a97-0fe11a1e69e7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.320055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d595fc0-a9d7-4c12-9cee-89c93d19fa18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.320758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d595fc0-a9d7-4c12-9cee-89c93d19fa18 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.321048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d595fc0-a9d7-4c12-9cee-89c93d19fa18 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.321703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d595fc0-a9d7-4c12-9cee-89c93d19fa18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.324900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6d595fc0-a9d7-4c12-9cee-89c93d19fa18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:32.330667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:32.354925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b0d90-7fb1-4300-985e-6a0fdbb0799e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.357190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b0d90-7fb1-4300-985e-6a0fdbb0799e service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.374737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 808/1634] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:32.376346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0d90-7fb1-4300-985e-6a0fdbb0799e service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.378111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b83b0d90-7fb1-4300-985e-6a0fdbb0799e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:32.389677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0d90-7fb1-4300-985e-6a0fdbb0799e service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.398522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f819-9dd2-46f1-b717-68eefddd5dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.399183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f819-9dd2-46f1-b717-68eefddd5dfd service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.400025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f819-9dd2-46f1-b717-68eefddd5dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.400355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f819-9dd2-46f1-b717-68eefddd5dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.419657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d595fc0-a9d7-4c12-9cee-89c93d19fa18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.422749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d595fc0-a9d7-4c12-9cee-89c93d19fa18 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.427088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f819-9dd2-46f1-b717-68eefddd5dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.428707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f819-9dd2-46f1-b717-68eefddd5dfd service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.440980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 827/1635] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:32.443069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d595fc0-a9d7-4c12-9cee-89c93d19fa18 service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.451659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 809/1636] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:32.452375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f819-9dd2-46f1-b717-68eefddd5dfd service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.466810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d595fc0-a9d7-4c12-9cee-89c93d19fa18 service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.467500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f819-9dd2-46f1-b717-68eefddd5dfd service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.475102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3997a-0396-499f-bff2-341b9fa5b3cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.475780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3997a-0396-499f-bff2-341b9fa5b3cb service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.476066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3997a-0396-499f-bff2-341b9fa5b3cb service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.476403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3997a-0396-499f-bff2-341b9fa5b3cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.478794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5bd3997a-0396-499f-bff2-341b9fa5b3cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:32.486078 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d745a-2ebd-43f2-be64-3e994b18466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.487368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d745a-2ebd-43f2-be64-3e994b18466b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.487866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d745a-2ebd-43f2-be64-3e994b18466b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.488368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d745a-2ebd-43f2-be64-3e994b18466b admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.489224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d745a-2ebd-43f2-be64-3e994b18466b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.491171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d745a-2ebd-43f2-be64-3e994b18466b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.515797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 828/1637] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:32.518052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d745a-2ebd-43f2-be64-3e994b18466b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.534353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:32.550236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d745a-2ebd-43f2-be64-3e994b18466b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.560812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd18dcb-37bd-4c8f-8d1d-aeb5161a7dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.561844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd18dcb-37bd-4c8f-8d1d-aeb5161a7dce admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.561952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd18dcb-37bd-4c8f-8d1d-aeb5161a7dce admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.562305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd18dcb-37bd-4c8f-8d1d-aeb5161a7dce admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.563222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd18dcb-37bd-4c8f-8d1d-aeb5161a7dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.564926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd18dcb-37bd-4c8f-8d1d-aeb5161a7dce admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.574945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3997a-0396-499f-bff2-341b9fa5b3cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.576875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3997a-0396-499f-bff2-341b9fa5b3cb service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.581974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 829/1638] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:32.583665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd18dcb-37bd-4c8f-8d1d-aeb5161a7dce admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.588653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 810/1639] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:32.590514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3997a-0396-499f-bff2-341b9fa5b3cb service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.601283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd18dcb-37bd-4c8f-8d1d-aeb5161a7dce admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.606282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3997a-0396-499f-bff2-341b9fa5b3cb service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.609927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2301-dae9-4877-b95f-1cfeca069541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.611152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2301-dae9-4877-b95f-1cfeca069541 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.611719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2301-dae9-4877-b95f-1cfeca069541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.612247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2301-dae9-4877-b95f-1cfeca069541 admin admin] PATH_INFO: `/v3/projects/df071f42acc34362ab4746edc8af2ff0/users/1e106b5804af4f6fb91059595cbf6e61/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.628947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef5d5f-ae52-495e-a110-dcead592ec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.629662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef5d5f-ae52-495e-a110-dcead592ec42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.629972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef5d5f-ae52-495e-a110-dcead592ec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.630238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef5d5f-ae52-495e-a110-dcead592ec42 admin admin] PATH_INFO: `/v3/projects/1c6c4e83c69449059a7dc3297e7dd1a3/users/436431598a424c88ace0fe8ba7e0309b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.632422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef5d5f-ae52-495e-a110-dcead592ec42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6c4e83c69449059a7dc3297e7dd1a3, user_id=436431598a424c88ace0fe8ba7e0309b, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.637737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef5d5f-ae52-495e-a110-dcead592ec42 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.638349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2301-dae9-4877-b95f-1cfeca069541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df071f42acc34362ab4746edc8af2ff0, user_id=1e106b5804af4f6fb91059595cbf6e61, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.642512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2301-dae9-4877-b95f-1cfeca069541 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.654390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 811/1640] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:32 2022] PUT /identity/v3/projects/1c6c4e83c69449059a7dc3297e7dd1a3/users/436431598a424c88ace0fe8ba7e0309b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:32.665659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3e0ad-e04a-4229-a5a4-c733a5799e2a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.666421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3e0ad-e04a-4229-a5a4-c733a5799e2a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.666710 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3e0ad-e04a-4229-a5a4-c733a5799e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.673650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 830/1641] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:32 2022] PUT /identity/v3/projects/df071f42acc34362ab4746edc8af2ff0/users/1e106b5804af4f6fb91059595cbf6e61/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:32.681834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2301-dae9-4877-b95f-1cfeca069541 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.763520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-cbb3e0ad-e04a-4229-a5a4-c733a5799e2a None None] MFA Rules not processed for user `436431598a424c88ace0fe8ba7e0309b`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:32.764969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cbb3e0ad-e04a-4229-a5a4-c733a5799e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:32.876738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2301-dae9-4877-b95f-1cfeca069541 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.888150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fbcc-d591-433c-bdb9-ce9706091acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.890563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fbcc-d591-433c-bdb9-ce9706091acc admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.891356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fbcc-d591-433c-bdb9-ce9706091acc admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.892001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fbcc-d591-433c-bdb9-ce9706091acc admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.893282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9fbcc-d591-433c-bdb9-ce9706091acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.896072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9fbcc-d591-433c-bdb9-ce9706091acc admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:32.934343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 831/1642] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:32.936590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fbcc-d591-433c-bdb9-ce9706091acc admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.952064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fbcc-d591-433c-bdb9-ce9706091acc admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:32.962629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 812/1643] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:32.966829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b19f9-620c-41f6-82bd-5a95e9105107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:32.967569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b19f9-620c-41f6-82bd-5a95e9105107 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:32.968311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b19f9-620c-41f6-82bd-5a95e9105107 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:32.968311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b19f9-620c-41f6-82bd-5a95e9105107 admin admin] PATH_INFO: `/v3/projects/df071f42acc34362ab4746edc8af2ff0/users/1e106b5804af4f6fb91059595cbf6e61/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:32.973868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b19f9-620c-41f6-82bd-5a95e9105107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df071f42acc34362ab4746edc8af2ff0, user_id=1e106b5804af4f6fb91059595cbf6e61, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:32.974473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3e0ad-e04a-4229-a5a4-c733a5799e2a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:32.975936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cbb3e0ad-e04a-4229-a5a4-c733a5799e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:32.989507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b19f9-620c-41f6-82bd-5a95e9105107 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:33.037876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 832/1644] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:32 2022] PUT /identity/v3/projects/df071f42acc34362ab4746edc8af2ff0/users/1e106b5804af4f6fb91059595cbf6e61/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:33.041232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f9f71-4d28-499f-b26b-0a7834b86f2e None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:33.041232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f9f71-4d28-499f-b26b-0a7834b86f2e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:33.041232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f9f71-4d28-499f-b26b-0a7834b86f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:33.101241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:33.141166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3e8f9f71-4d28-499f-b26b-0a7834b86f2e None None] MFA Rules not processed for user `1e106b5804af4f6fb91059595cbf6e61`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:33.142486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3e8f9f71-4d28-499f-b26b-0a7834b86f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:33.157239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3e0ad-e04a-4229-a5a4-c733a5799e2a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:33.329788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a939c10-2ca0-453a-8769-7c34b3c287da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:33.330903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a939c10-2ca0-453a-8769-7c34b3c287da service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:33.331423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a939c10-2ca0-453a-8769-7c34b3c287da service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:33.332301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a939c10-2ca0-453a-8769-7c34b3c287da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:33.354238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 833/1645] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:47:33.355670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738b98-542e-41c0-9017-ae1a5f1cb412 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:33.355954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738b98-542e-41c0-9017-ae1a5f1cb412 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:33.356248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738b98-542e-41c0-9017-ae1a5f1cb412 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:33.366125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 834/1646] 10.222.0.65 () {54 vars in 912 bytes} [Thu Aug 18 20:47:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:33.367533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f167eb7-16da-4a2d-a588-87f7a9c5c948 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:33.367824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f167eb7-16da-4a2d-a588-87f7a9c5c948 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:33.368098 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f167eb7-16da-4a2d-a588-87f7a9c5c948 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:33.370535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 835/1647] 10.222.0.65 () {54 vars in 912 bytes} [Thu Aug 18 20:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:33.377186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f167eb7-16da-4a2d-a588-87f7a9c5c948 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:33.386043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3f167eb7-16da-4a2d-a588-87f7a9c5c948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:33.434072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f167eb7-16da-4a2d-a588-87f7a9c5c948 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:33.442264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a97b0-94f3-4f8d-9b99-fff80d5b63c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:33.442942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a97b0-94f3-4f8d-9b99-fff80d5b63c9 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:33.443222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a97b0-94f3-4f8d-9b99-fff80d5b63c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:33.443493 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a97b0-94f3-4f8d-9b99-fff80d5b63c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:33.467272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a97b0-94f3-4f8d-9b99-fff80d5b63c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:33.468679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a97b0-94f3-4f8d-9b99-fff80d5b63c9 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:33.491817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 836/1648] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:33 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:33.492036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d40cf-8675-4041-b135-3b3beb6563e7 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:33.493140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d40cf-8675-4041-b135-3b3beb6563e7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:33.493140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d40cf-8675-4041-b135-3b3beb6563e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:33.512382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a939c10-2ca0-453a-8769-7c34b3c287da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:33.515896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a939c10-2ca0-453a-8769-7c34b3c287da service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:33.538797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-df1d40cf-8675-4041-b135-3b3beb6563e7 None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:33.545074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-df1d40cf-8675-4041-b135-3b3beb6563e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:33.549686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 813/1649] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:33.554713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb53c9d-70b9-48e5-9267-45939edcc2bd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:33.555313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb53c9d-70b9-48e5-9267-45939edcc2bd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:33.555835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb53c9d-70b9-48e5-9267-45939edcc2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:33.601357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:33.633131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ffb53c9d-70b9-48e5-9267-45939edcc2bd None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:33.635038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ffb53c9d-70b9-48e5-9267-45939edcc2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:33.722432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 837/1650] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:47:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:33.752480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d40cf-8675-4041-b135-3b3beb6563e7 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:33.772761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d40cf-8675-4041-b135-3b3beb6563e7 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:33.786729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f405-c9b5-4488-81e3-b5118be72dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:33.787405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f405-c9b5-4488-81e3-b5118be72dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:33.787682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f405-c9b5-4488-81e3-b5118be72dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:33.788054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f405-c9b5-4488-81e3-b5118be72dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:33.802593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f405-c9b5-4488-81e3-b5118be72dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:33.804249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f405-c9b5-4488-81e3-b5118be72dc2 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:33.839542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 838/1651] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:47:33.879909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f405-c9b5-4488-81e3-b5118be72dc2 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:33.881577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-bf65f405-c9b5-4488-81e3-b5118be72dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:33.908842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 814/1652] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:47:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:33.931880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb53c9d-70b9-48e5-9267-45939edcc2bd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:34.026126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f405-c9b5-4488-81e3-b5118be72dc2 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:34.037610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:34.071414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:34.075485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:34.077390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:34.077522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] PATH_INFO: `/v3/projects/85dce823f27e4810944dfbfb4eb152aa` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:34.081224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85dce823f27e4810944dfbfb4eb152aa)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:34.086648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: WARNING py.warnings [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:47:34.086648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: warnings.warn(msg) Aug 18 20:47:34.086648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: Aug 18 20:47:34.087932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:34.140050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb53c9d-70b9-48e5-9267-45939edcc2bd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:34.161234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:34.162165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:34.163661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:34.166814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] PATH_INFO: `/v3/users/4c15efe9dbba4c57be0e3b14b3357a46` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:34.175778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c15efe9dbba4c57be0e3b14b3357a46)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:34.177370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: WARNING py.warnings [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:47:34.177370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: warnings.warn(msg) Aug 18 20:47:34.177370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: Aug 18 20:47:34.179331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:34.302437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85dce823f27e4810944dfbfb4eb152aa', 'request_id': 'req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.319152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85dce823f27e4810944dfbfb4eb152aa', 'request_id': 'req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.323177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c15efe9dbba4c57be0e3b14b3357a46'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.335925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85dce823f27e4810944dfbfb4eb152aa', 'request_id': 'req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.352960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c15efe9dbba4c57be0e3b14b3357a46'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.374003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c15efe9dbba4c57be0e3b14b3357a46'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.389770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] The token cache is being invalidate because project 85dce823f27e4810944dfbfb4eb152aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:34.390682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.392244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.398811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 839/1653] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:33 2022] DELETE /identity/v3/projects/85dce823f27e4810944dfbfb4eb152aa => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:47:34.399034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:34.406348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:34.413875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c15efe9dbba4c57be0e3b14b3357a46'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.414596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c15efe9dbba4c57be0e3b14b3357a46'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.428373 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 815/1654] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:33 2022] DELETE /identity/v3/users/4c15efe9dbba4c57be0e3b14b3357a46 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:34.429800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:34.431754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:34.499452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:34.534129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16cdf8-0ff4-4151-89d9-d91c2aaca484 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:34.539461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:34.540121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:34.540841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:34.541188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] PATH_INFO: `/v3/users/2b6372a5e789479a9b9c86a577138284` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:34.542685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6372a5e789479a9b9c86a577138284)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:34.545701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:34.564359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5489-d6fb-4403-8f6c-94a68ee01ae1 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:34.653964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6372a5e789479a9b9c86a577138284'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.674254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6372a5e789479a9b9c86a577138284'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.676501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:34.687172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6372a5e789479a9b9c86a577138284'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.700846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:34.701486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:34.701813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:34.702043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:34.706519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:34.718536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6372a5e789479a9b9c86a577138284'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.719759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-94b8d3a6-603d-4a8b-a07f-256d690d262f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6372a5e789479a9b9c86a577138284'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:34.728918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 816/1655] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:34 2022] DELETE /identity/v3/users/2b6372a5e789479a9b9c86a577138284 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:34.731702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa5ddb-6b66-4a87-a0cf-13e28101ef90 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:34.732110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa5ddb-6b66-4a87-a0cf-13e28101ef90 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:34.732524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa5ddb-6b66-4a87-a0cf-13e28101ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:34.767979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3baa5ddb-6b66-4a87-a0cf-13e28101ef90 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:34.769870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3baa5ddb-6b66-4a87-a0cf-13e28101ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:34.837174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:34.842293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:34.860815 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 840/1656] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:34.902942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:34.907267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 817/1657] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:34.908608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:34.922040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b6206-3edf-4bbe-86b8-0881bf536839 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:34.979801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa5ddb-6b66-4a87-a0cf-13e28101ef90 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:34.985434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3baa5ddb-6b66-4a87-a0cf-13e28101ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:35.012180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:35.013513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:35.013513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:35.013513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:35.016725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:35.128682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:35.158873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:35.159999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:35.165240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa5ddb-6b66-4a87-a0cf-13e28101ef90 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:35.173455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4ad35-5f22-4ab3-acb9-6404a164b862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:35.174087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4ad35-5f22-4ab3-acb9-6404a164b862 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:35.174368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4ad35-5f22-4ab3-acb9-6404a164b862 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:35.174639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4ad35-5f22-4ab3-acb9-6404a164b862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:35.207805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 841/1658] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:47:35.217064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4ad35-5f22-4ab3-acb9-6404a164b862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:35.218988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4ad35-5f22-4ab3-acb9-6404a164b862 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:35.249755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 818/1659] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:36.158262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:36.159811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:36.200108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cde25-cf58-4e6c-8d15-6a71df1d2a5a service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:36.218960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:36.218960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:36.218960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:36.218960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] PATH_INFO: `/v3/users/f815bcdc19494ddba3f35ecacf70d6ee` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:36.221035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f815bcdc19494ddba3f35ecacf70d6ee)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:36.223062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:36.338656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f815bcdc19494ddba3f35ecacf70d6ee'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:36.343117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f815bcdc19494ddba3f35ecacf70d6ee'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:36.378736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f815bcdc19494ddba3f35ecacf70d6ee'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:36.403491 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f815bcdc19494ddba3f35ecacf70d6ee'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:36.405477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f815bcdc19494ddba3f35ecacf70d6ee'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:36.455618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 842/1660] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:36 2022] DELETE /identity/v3/users/f815bcdc19494ddba3f35ecacf70d6ee => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:36.459458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c530040-c13e-414f-9851-11b5e079fee7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:36.459892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c530040-c13e-414f-9851-11b5e079fee7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:36.460021 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c530040-c13e-414f-9851-11b5e079fee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:36.507571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0c530040-c13e-414f-9851-11b5e079fee7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:36.507571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0c530040-c13e-414f-9851-11b5e079fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:36.670369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 819/1661] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:36.750798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:36.752434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:36.911160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c497760-a038-4b23-a746-0faccfe8d3ad admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:36.918494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb9272-b95a-4135-b873-b749a5c4ec47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:36.918956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb9272-b95a-4135-b873-b749a5c4ec47 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:36.919344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb9272-b95a-4135-b873-b749a5c4ec47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:36.919644 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb9272-b95a-4135-b873-b749a5c4ec47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:36.933419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb9272-b95a-4135-b873-b749a5c4ec47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:36.937658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb9272-b95a-4135-b873-b749a5c4ec47 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:36.966923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 843/1662] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:37.135213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c530040-c13e-414f-9851-11b5e079fee7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:37.138885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0c530040-c13e-414f-9851-11b5e079fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:37.173786 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c530040-c13e-414f-9851-11b5e079fee7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:37.187647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:37.188451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:37.188736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:37.189014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] PATH_INFO: `/v3/projects/b14dbdc08c64423f8e6a311526ace277` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:37.190240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14dbdc08c64423f8e6a311526ace277)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:37.192246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:37.232800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:37.270006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb9272-b95a-4135-b873-b749a5c4ec47 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:37.271650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9efb9272-b95a-4135-b873-b749a5c4ec47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:37.293948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb9272-b95a-4135-b873-b749a5c4ec47 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:37.331009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14dbdc08c64423f8e6a311526ace277', 'request_id': 'req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.345503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14dbdc08c64423f8e6a311526ace277', 'request_id': 'req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.362238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14dbdc08c64423f8e6a311526ace277', 'request_id': 'req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.400147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] The token cache is being invalidate because project b14dbdc08c64423f8e6a311526ace277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:37.400449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.403848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-afc7cdb2-9d81-4f61-b74d-92602b6f65fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.411114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 820/1663] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:37 2022] DELETE /identity/v3/projects/b14dbdc08c64423f8e6a311526ace277 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:37.413769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dd75e-92d1-40b7-826d-9b7ca6ca6fcd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:37.414055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dd75e-92d1-40b7-826d-9b7ca6ca6fcd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:37.414341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dd75e-92d1-40b7-826d-9b7ca6ca6fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:37.438560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:37.458251 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:37.458738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:37.459048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:37.459323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] PATH_INFO: `/v3/users/25602770c6774c76b07e4e8dd01be913` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:37.460624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25602770c6774c76b07e4e8dd01be913)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:37.462612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:37.478490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-102dd75e-92d1-40b7-826d-9b7ca6ca6fcd None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:37.480704 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-102dd75e-92d1-40b7-826d-9b7ca6ca6fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:37.492559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 821/1664] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:37.493585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dd75e-92d1-40b7-826d-9b7ca6ca6fcd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:37.494965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-102dd75e-92d1-40b7-826d-9b7ca6ca6fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:37.514162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dd75e-92d1-40b7-826d-9b7ca6ca6fcd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:37.520871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:37.521588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:37.521959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:37.522583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] PATH_INFO: `/v3/projects/f240af4fa4f24cd7812e5c71785fddc8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:37.523891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f240af4fa4f24cd7812e5c71785fddc8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:37.526254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:37.564943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25602770c6774c76b07e4e8dd01be913'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.565659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25602770c6774c76b07e4e8dd01be913'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.596173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25602770c6774c76b07e4e8dd01be913'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.613202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25602770c6774c76b07e4e8dd01be913'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.614634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-98c5360f-ca3d-4b60-a548-111c44c210a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25602770c6774c76b07e4e8dd01be913'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.642654 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 844/1665] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:37 2022] DELETE /identity/v3/users/25602770c6774c76b07e4e8dd01be913 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:37.644098 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e40c34-8341-4b07-b0e9-ff26a8c32398 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:37.644390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e40c34-8341-4b07-b0e9-ff26a8c32398 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:37.644669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e40c34-8341-4b07-b0e9-ff26a8c32398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:37.662195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f240af4fa4f24cd7812e5c71785fddc8', 'request_id': 'req-4f9dba48-3cae-4311-8004-ece1c7591375'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.679927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f240af4fa4f24cd7812e5c71785fddc8', 'request_id': 'req-4f9dba48-3cae-4311-8004-ece1c7591375'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.696616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f240af4fa4f24cd7812e5c71785fddc8', 'request_id': 'req-4f9dba48-3cae-4311-8004-ece1c7591375'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.701461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-36e40c34-8341-4b07-b0e9-ff26a8c32398 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:37.702713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-36e40c34-8341-4b07-b0e9-ff26a8c32398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:37.721228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] The token cache is being invalidate because project f240af4fa4f24cd7812e5c71785fddc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:37.721537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.724032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4f9dba48-3cae-4311-8004-ece1c7591375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:37.737483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 822/1666] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:37 2022] DELETE /identity/v3/projects/f240af4fa4f24cd7812e5c71785fddc8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:37.745533 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05363b7a-fadb-4d0d-b9f8-47dc3a6834cf None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:37.745854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05363b7a-fadb-4d0d-b9f8-47dc3a6834cf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:37.746188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05363b7a-fadb-4d0d-b9f8-47dc3a6834cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:37.797493 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-05363b7a-fadb-4d0d-b9f8-47dc3a6834cf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:37.798728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-05363b7a-fadb-4d0d-b9f8-47dc3a6834cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:37.881963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 845/1667] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:37.883595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e40c34-8341-4b07-b0e9-ff26a8c32398 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:37.888504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-36e40c34-8341-4b07-b0e9-ff26a8c32398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:37.894978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 823/1668] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:37.895552 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05363b7a-fadb-4d0d-b9f8-47dc3a6834cf None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:37.907617 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e40c34-8341-4b07-b0e9-ff26a8c32398 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:37.915708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:37.916217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05363b7a-fadb-4d0d-b9f8-47dc3a6834cf None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:37.916583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:37.917099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:37.917650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] PATH_INFO: `/v3/users/1e106b5804af4f6fb91059595cbf6e61` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:37.919364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e106b5804af4f6fb91059595cbf6e61)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:37.922792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:37.923301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:37.924140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:37.924619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:37.925381 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:37.926290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:37.926736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:37.929780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:37.967951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 824/1669] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:37.969192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:37.974264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:37.996761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:38.040090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e106b5804af4f6fb91059595cbf6e61'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:38.042198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e106b5804af4f6fb91059595cbf6e61'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:38.091508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e106b5804af4f6fb91059595cbf6e61'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:38.109755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e106b5804af4f6fb91059595cbf6e61'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:38.110674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e106b5804af4f6fb91059595cbf6e61'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:38.112302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:38.155553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 846/1670] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:37 2022] DELETE /identity/v3/users/1e106b5804af4f6fb91059595cbf6e61 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:38.156548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:38.161167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:38.193718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a799-6af2-4357-b848-4179416e2fb8 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:38.348175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0796a66-7c96-46d9-8b9a-3318b677ed40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:38.348528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0796a66-7c96-46d9-8b9a-3318b677ed40 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:38.350213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0796a66-7c96-46d9-8b9a-3318b677ed40 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:38.350350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0796a66-7c96-46d9-8b9a-3318b677ed40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:38.356444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a0796a66-7c96-46d9-8b9a-3318b677ed40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:38.379944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6686e3f-da4f-4f78-a815-0e942f0bfbf6 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:38.393679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0796a66-7c96-46d9-8b9a-3318b677ed40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:38.397121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2d822-8b72-4e54-b363-0140e404751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:38.397463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2d822-8b72-4e54-b363-0140e404751b admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:38.397746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2d822-8b72-4e54-b363-0140e404751b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:38.398575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2d822-8b72-4e54-b363-0140e404751b admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:38.398675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0796a66-7c96-46d9-8b9a-3318b677ed40 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:38.399858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2d822-8b72-4e54-b363-0140e404751b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:38.407007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2d822-8b72-4e54-b363-0140e404751b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:38.425981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 825/1671] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:38.467613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 847/1672] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:38 2022] POST /identity/v3/projects => generated 387 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:38.471162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0796a66-7c96-46d9-8b9a-3318b677ed40 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:38.484961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0796a66-7c96-46d9-8b9a-3318b677ed40 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:38.604138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cce085-432c-4488-adfa-ebc1703a1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:38.606586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cce085-432c-4488-adfa-ebc1703a1503 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:38.607003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cce085-432c-4488-adfa-ebc1703a1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:38.607352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cce085-432c-4488-adfa-ebc1703a1503 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:38.608952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cce085-432c-4488-adfa-ebc1703a1503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:38.611293 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cce085-432c-4488-adfa-ebc1703a1503 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:38.646829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 826/1673] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:38 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:38.649128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2d822-8b72-4e54-b363-0140e404751b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:38.667543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2d822-8b72-4e54-b363-0140e404751b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:38.686660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646759e-c759-4617-937a-9a23183b8ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:38.687536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646759e-c759-4617-937a-9a23183b8ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:38.687950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646759e-c759-4617-937a-9a23183b8ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:38.688293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646759e-c759-4617-937a-9a23183b8ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:38.689087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646759e-c759-4617-937a-9a23183b8ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:38.691389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646759e-c759-4617-937a-9a23183b8ea7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:38.711489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 848/1674] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:38.713022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cce085-432c-4488-adfa-ebc1703a1503 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:38.727827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cce085-432c-4488-adfa-ebc1703a1503 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:38.734734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6c5ca-1460-4478-8b44-69939efbdcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:38.735534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c5ca-1460-4478-8b44-69939efbdcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:38.735759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c5ca-1460-4478-8b44-69939efbdcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:38.736030 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c5ca-1460-4478-8b44-69939efbdcf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:38.736850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6c5ca-1460-4478-8b44-69939efbdcf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:38.738600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6c5ca-1460-4478-8b44-69939efbdcf9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:38.759388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 827/1675] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:38.760693 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646759e-c759-4617-937a-9a23183b8ea7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:38.777392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646759e-c759-4617-937a-9a23183b8ea7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:38.788391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf822a72-af3f-4de0-b7b8-2a7e9680d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:38.789256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf822a72-af3f-4de0-b7b8-2a7e9680d33f admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:38.789730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf822a72-af3f-4de0-b7b8-2a7e9680d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:38.790046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf822a72-af3f-4de0-b7b8-2a7e9680d33f admin admin] PATH_INFO: `/v3/projects/0d65f3444a2b499c8c1d60f1b4b48b7e/users/701297cde71940aca086669a89327051/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:38.812190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf822a72-af3f-4de0-b7b8-2a7e9680d33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d65f3444a2b499c8c1d60f1b4b48b7e, user_id=701297cde71940aca086669a89327051, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:38.816157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf822a72-af3f-4de0-b7b8-2a7e9680d33f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:38.851456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 849/1676] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:38 2022] PUT /identity/v3/projects/0d65f3444a2b499c8c1d60f1b4b48b7e/users/701297cde71940aca086669a89327051/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:38.854241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe93eb-1b4f-442a-97d4-f2b5ed14279e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:38.855170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe93eb-1b4f-442a-97d4-f2b5ed14279e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:38.855480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe93eb-1b4f-442a-97d4-f2b5ed14279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:38.918344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-cabe93eb-1b4f-442a-97d4-f2b5ed14279e None None] MFA Rules not processed for user `701297cde71940aca086669a89327051`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:38.921036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cabe93eb-1b4f-442a-97d4-f2b5ed14279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:39.003859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:39.130259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 828/1677] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:39.135166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf822a72-af3f-4de0-b7b8-2a7e9680d33f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:39.240141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf822a72-af3f-4de0-b7b8-2a7e9680d33f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:39.246324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e1278-388f-450f-8cd9-9c77cebad5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:39.246968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e1278-388f-450f-8cd9-9c77cebad5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:39.247254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e1278-388f-450f-8cd9-9c77cebad5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:39.247525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e1278-388f-450f-8cd9-9c77cebad5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:39.248935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e1278-388f-450f-8cd9-9c77cebad5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:39.252177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e1278-388f-450f-8cd9-9c77cebad5b6 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:39.298369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 850/1678] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:39 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:47:39.299965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe93eb-1b4f-442a-97d4-f2b5ed14279e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:39.352605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe93eb-1b4f-442a-97d4-f2b5ed14279e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:39.571193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84df0-67eb-4769-b40e-6c4aabc4c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:39.572890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84df0-67eb-4769-b40e-6c4aabc4c625 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:39.574129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84df0-67eb-4769-b40e-6c4aabc4c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:39.574825 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84df0-67eb-4769-b40e-6c4aabc4c625 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:39.575854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a84df0-67eb-4769-b40e-6c4aabc4c625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:39.580634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a84df0-67eb-4769-b40e-6c4aabc4c625 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:39.622759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 829/1679] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:39 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:39.627243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e1278-388f-450f-8cd9-9c77cebad5b6 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:39.642363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e1278-388f-450f-8cd9-9c77cebad5b6 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:39.666230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84df0-67eb-4769-b40e-6c4aabc4c625 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:39.667415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45622-f180-4ced-a3e8-1a07b0239751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:39.668173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-26a84df0-67eb-4769-b40e-6c4aabc4c625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:39.678068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45622-f180-4ced-a3e8-1a07b0239751 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:39.678349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45622-f180-4ced-a3e8-1a07b0239751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:39.678635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45622-f180-4ced-a3e8-1a07b0239751 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:39.679335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45622-f180-4ced-a3e8-1a07b0239751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:39.680981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45622-f180-4ced-a3e8-1a07b0239751 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:39.697581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84df0-67eb-4769-b40e-6c4aabc4c625 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:39.716129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:39.716808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:39.717128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:39.717358 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] PATH_INFO: `/v3/projects/34a01aa218f742d488e483e433d5d6f6` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:39.718823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a01aa218f742d488e483e433d5d6f6)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:39.720777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:39.726133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 851/1680] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:39.730379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45622-f180-4ced-a3e8-1a07b0239751 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:39.760796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45622-f180-4ced-a3e8-1a07b0239751 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:39.768009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46046be4-0a08-45f6-b93a-2a284b29dbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:39.768950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046be4-0a08-45f6-b93a-2a284b29dbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:39.769367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046be4-0a08-45f6-b93a-2a284b29dbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:39.769858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046be4-0a08-45f6-b93a-2a284b29dbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:39.770888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046be4-0a08-45f6-b93a-2a284b29dbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:39.773026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046be4-0a08-45f6-b93a-2a284b29dbb0 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:39.800631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 852/1681] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:39.802395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46046be4-0a08-45f6-b93a-2a284b29dbb0 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:39.820868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:39.838389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46046be4-0a08-45f6-b93a-2a284b29dbb0 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:39.844582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a01aa218f742d488e483e433d5d6f6', 'request_id': 'req-f9e8c032-3a68-4c16-b92b-855398f6fabd'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:39.859580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a01aa218f742d488e483e433d5d6f6', 'request_id': 'req-f9e8c032-3a68-4c16-b92b-855398f6fabd'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:39.873519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a01aa218f742d488e483e433d5d6f6', 'request_id': 'req-f9e8c032-3a68-4c16-b92b-855398f6fabd'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:39.925074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] The token cache is being invalidate because project 34a01aa218f742d488e483e433d5d6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:39.925635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:39.926988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:39.930443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 830/1682] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:39 2022] DELETE /identity/v3/projects/34a01aa218f742d488e483e433d5d6f6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:39.936123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:39.940459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:39.981771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74449f36-bd29-4aba-8722-48b93d229a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:39.982480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74449f36-bd29-4aba-8722-48b93d229a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:39.982822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74449f36-bd29-4aba-8722-48b93d229a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:39.983018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74449f36-bd29-4aba-8722-48b93d229a65 admin admin] PATH_INFO: `/v3/projects/8986cd573b6044b0a35366520e0f9b4a/users/7a4751af58e94a81809422241e0ac917/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:40.018321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74449f36-bd29-4aba-8722-48b93d229a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8986cd573b6044b0a35366520e0f9b4a, user_id=7a4751af58e94a81809422241e0ac917, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:40.024288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74449f36-bd29-4aba-8722-48b93d229a65 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:40.070949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:40.075996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 853/1683] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:39 2022] PUT /identity/v3/projects/8986cd573b6044b0a35366520e0f9b4a/users/7a4751af58e94a81809422241e0ac917/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:40.088264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2531-797d-437c-900f-82b60940f459 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:40.088550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2531-797d-437c-900f-82b60940f459 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:40.088825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2531-797d-437c-900f-82b60940f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:40.144729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c032-3a68-4c16-b92b-855398f6fabd admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:40.193620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-51bc2531-797d-437c-900f-82b60940f459 None None] MFA Rules not processed for user `7a4751af58e94a81809422241e0ac917`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:40.195506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-51bc2531-797d-437c-900f-82b60940f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:40.356330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:40.357019 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:40.357295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:40.357575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] PATH_INFO: `/v3/users/436431598a424c88ace0fe8ba7e0309b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:40.366602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=436431598a424c88ace0fe8ba7e0309b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:40.369805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:40.390022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 854/1684] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:40.390946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2531-797d-437c-900f-82b60940f459 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:40.394128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-51bc2531-797d-437c-900f-82b60940f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:40.426093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2531-797d-437c-900f-82b60940f459 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:40.437955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:40.438632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:40.439746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:40.441977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] PATH_INFO: `/v3/projects/df071f42acc34362ab4746edc8af2ff0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:40.444002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df071f42acc34362ab4746edc8af2ff0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:40.446711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:40.482918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436431598a424c88ace0fe8ba7e0309b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.501234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436431598a424c88ace0fe8ba7e0309b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.521551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436431598a424c88ace0fe8ba7e0309b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.555091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436431598a424c88ace0fe8ba7e0309b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.561412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436431598a424c88ace0fe8ba7e0309b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.582832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 831/1685] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:39 2022] DELETE /identity/v3/users/436431598a424c88ace0fe8ba7e0309b => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:40.582832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:40.583749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df071f42acc34362ab4746edc8af2ff0', 'request_id': 'req-2fd0fcab-73f8-4977-be00-073706039bb5'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.585998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:40.603341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df071f42acc34362ab4746edc8af2ff0', 'request_id': 'req-2fd0fcab-73f8-4977-be00-073706039bb5'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.624831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df071f42acc34362ab4746edc8af2ff0', 'request_id': 'req-2fd0fcab-73f8-4977-be00-073706039bb5'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.638685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:40.651849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] The token cache is being invalidate because project df071f42acc34362ab4746edc8af2ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:40.652269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.657306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2fd0fcab-73f8-4977-be00-073706039bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:40.663459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 855/1686] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:40 2022] DELETE /identity/v3/projects/df071f42acc34362ab4746edc8af2ff0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:40.668612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978fa0-1187-43ce-a710-2a93a4ce6b4d None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:40.668901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978fa0-1187-43ce-a710-2a93a4ce6b4d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:40.669325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978fa0-1187-43ce-a710-2a93a4ce6b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:40.718614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-cd978fa0-1187-43ce-a710-2a93a4ce6b4d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:40.719934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-cd978fa0-1187-43ce-a710-2a93a4ce6b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:40.791564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab335-22e1-43cb-8047-b716a849f7de admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:40.809315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae5e9c-9d9c-4d2c-b18c-55e60df5763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:40.809829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae5e9c-9d9c-4d2c-b18c-55e60df5763c admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:40.810113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae5e9c-9d9c-4d2c-b18c-55e60df5763c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:40.810449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae5e9c-9d9c-4d2c-b18c-55e60df5763c admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:40.811250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae5e9c-9d9c-4d2c-b18c-55e60df5763c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:40.813295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae5e9c-9d9c-4d2c-b18c-55e60df5763c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:40.887156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:40.920576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 832/1687] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:40 2022] POST /identity/v3/projects => generated 387 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:40.921706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae5e9c-9d9c-4d2c-b18c-55e60df5763c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:40.923990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0aae5e9c-9d9c-4d2c-b18c-55e60df5763c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:40.944551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 856/1688] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:40.946461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad6c86-ac4c-4bd1-9e0d-32f9eff51dab None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:40.946852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad6c86-ac4c-4bd1-9e0d-32f9eff51dab None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:40.948322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad6c86-ac4c-4bd1-9e0d-32f9eff51dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.019757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1cad6c86-ac4c-4bd1-9e0d-32f9eff51dab None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:41.023535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1cad6c86-ac4c-4bd1-9e0d-32f9eff51dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:41.126214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae5e9c-9d9c-4d2c-b18c-55e60df5763c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:41.158137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5edca9-0b05-450b-a2c8-23a4603e6b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:41.158890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5edca9-0b05-450b-a2c8-23a4603e6b9a admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:41.159176 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5edca9-0b05-450b-a2c8-23a4603e6b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:41.160178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5edca9-0b05-450b-a2c8-23a4603e6b9a admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.160911 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5edca9-0b05-450b-a2c8-23a4603e6b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:41.163127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5edca9-0b05-450b-a2c8-23a4603e6b9a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:41.199633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 833/1689] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:40 2022] POST /identity/v3/users => generated 300 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:41.202616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5edca9-0b05-450b-a2c8-23a4603e6b9a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:41.229031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5edca9-0b05-450b-a2c8-23a4603e6b9a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:41.238940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 857/1690] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:41.240696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6380cf-f549-42fd-869a-a9c8bdddcfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:41.241761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6380cf-f549-42fd-869a-a9c8bdddcfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:41.242236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6380cf-f549-42fd-869a-a9c8bdddcfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:41.243094 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6380cf-f549-42fd-869a-a9c8bdddcfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.244288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6380cf-f549-42fd-869a-a9c8bdddcfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:41.246203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad6c86-ac4c-4bd1-9e0d-32f9eff51dab None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:41.248809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6380cf-f549-42fd-869a-a9c8bdddcfc3 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:41.275813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 834/1691] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:41.278728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad6c86-ac4c-4bd1-9e0d-32f9eff51dab None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:41.280311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6380cf-f549-42fd-869a-a9c8bdddcfc3 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:41.284301 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:41.285550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:41.285834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:41.286104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.288428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:41.288428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:41.291404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:41.303170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6380cf-f549-42fd-869a-a9c8bdddcfc3 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:41.316646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e8fd3-15b0-443d-bc18-0f192ff50bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:41.317335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8fd3-15b0-443d-bc18-0f192ff50bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:41.317619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8fd3-15b0-443d-bc18-0f192ff50bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:41.317894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8fd3-15b0-443d-bc18-0f192ff50bd5 admin admin] PATH_INFO: `/v3/projects/52d42309a6b744d3ad023f25355deed6/users/f734e7ce23c248a0a4dfb55fbea10b74/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.325766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 858/1692] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:41.327244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:41.331509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:41.357137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e8fd3-15b0-443d-bc18-0f192ff50bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d42309a6b744d3ad023f25355deed6, user_id=f734e7ce23c248a0a4dfb55fbea10b74, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:41.359877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e8fd3-15b0-443d-bc18-0f192ff50bd5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:41.362083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256bea7-73c5-4776-a390-1a072753bf17 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:41.368906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:41.369564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:41.369917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:41.370199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] PATH_INFO: `/v3/users/9b05728af02a443e9da7763664096d76` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.373355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b05728af02a443e9da7763664096d76)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:41.375634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:41.388561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 835/1693] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:41 2022] PUT /identity/v3/projects/52d42309a6b744d3ad023f25355deed6/users/f734e7ce23c248a0a4dfb55fbea10b74/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:41.389424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e8fd3-15b0-443d-bc18-0f192ff50bd5 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:41.522979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b05728af02a443e9da7763664096d76'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:41.523715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b05728af02a443e9da7763664096d76'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:41.537318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e8fd3-15b0-443d-bc18-0f192ff50bd5 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:41.547729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf695d5-46a5-4acd-9985-178eb3dd1363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:41.548371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf695d5-46a5-4acd-9985-178eb3dd1363 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:41.563731 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf695d5-46a5-4acd-9985-178eb3dd1363 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:41.564033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf695d5-46a5-4acd-9985-178eb3dd1363 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.564739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf695d5-46a5-4acd-9985-178eb3dd1363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:41.566729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf695d5-46a5-4acd-9985-178eb3dd1363 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:41.587732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b05728af02a443e9da7763664096d76'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:41.612680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b05728af02a443e9da7763664096d76'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:41.613602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b05728af02a443e9da7763664096d76'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:41.622866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 836/1694] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:41 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:41.623774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf695d5-46a5-4acd-9985-178eb3dd1363 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:41.631875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3cf695d5-46a5-4acd-9985-178eb3dd1363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:41.639122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:41.659830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 859/1695] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:41 2022] DELETE /identity/v3/users/9b05728af02a443e9da7763664096d76 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:41.660851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:41.666702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:41.713494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:41.791867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf695d5-46a5-4acd-9985-178eb3dd1363 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:41.887186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d3151-850c-4954-9f22-fad13e804cf3 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:41.894005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97e38d-fe41-42f2-8946-690ab630ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:41.894646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97e38d-fe41-42f2-8946-690ab630ae84 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:41.894956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97e38d-fe41-42f2-8946-690ab630ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:41.895235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97e38d-fe41-42f2-8946-690ab630ae84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.895896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97e38d-fe41-42f2-8946-690ab630ae84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:41.897554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97e38d-fe41-42f2-8946-690ab630ae84 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:41.900685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:41.903347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:41.903633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:41.903911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] PATH_INFO: `/v3/projects/7e507634340d4ea6b0c6816855e6b0b1` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.916780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e507634340d4ea6b0c6816855e6b0b1)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:41.920470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:41.926439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 837/1696] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:41.927703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97e38d-fe41-42f2-8946-690ab630ae84 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:41.931642 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-de97e38d-fe41-42f2-8946-690ab630ae84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:41.954193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97e38d-fe41-42f2-8946-690ab630ae84 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:41.962449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19502578-285c-4f8f-8242-2aa4cef1e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:41.964521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502578-285c-4f8f-8242-2aa4cef1e336 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:41.965347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502578-285c-4f8f-8242-2aa4cef1e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:41.966463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502578-285c-4f8f-8242-2aa4cef1e336 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:41.968003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19502578-285c-4f8f-8242-2aa4cef1e336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:41.971233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19502578-285c-4f8f-8242-2aa4cef1e336 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:42.008243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 838/1697] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:41 2022] POST /identity/v3/users => generated 293 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:42.010125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11ef29-f6e1-4286-86a2-c66ded9d2e04 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:42.011722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11ef29-f6e1-4286-86a2-c66ded9d2e04 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:42.012331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11ef29-f6e1-4286-86a2-c66ded9d2e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:42.045931 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-bd11ef29-f6e1-4286-86a2-c66ded9d2e04 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:42.048875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bd11ef29-f6e1-4286-86a2-c66ded9d2e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:42.060924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e507634340d4ea6b0c6816855e6b0b1', 'request_id': 'req-7c644bbf-e694-402f-812d-4d2e58fda3fa'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.075667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e507634340d4ea6b0c6816855e6b0b1', 'request_id': 'req-7c644bbf-e694-402f-812d-4d2e58fda3fa'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.093629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e507634340d4ea6b0c6816855e6b0b1', 'request_id': 'req-7c644bbf-e694-402f-812d-4d2e58fda3fa'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.142569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] The token cache is being invalidate because project 7e507634340d4ea6b0c6816855e6b0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:42.142894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.151291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.153755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 860/1698] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:41 2022] DELETE /identity/v3/projects/7e507634340d4ea6b0c6816855e6b0b1 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:42.154738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:42.156262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:42.221329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 839/1699] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:42.222338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11ef29-f6e1-4286-86a2-c66ded9d2e04 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:42.226797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bd11ef29-f6e1-4286-86a2-c66ded9d2e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:42.256461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11ef29-f6e1-4286-86a2-c66ded9d2e04 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:42.267681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff533a9-1826-4106-8bc0-7552eb44e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:42.269189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff533a9-1826-4106-8bc0-7552eb44e99b admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:42.269189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff533a9-1826-4106-8bc0-7552eb44e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:42.270913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff533a9-1826-4106-8bc0-7552eb44e99b admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:42.272357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff533a9-1826-4106-8bc0-7552eb44e99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:42.277822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff533a9-1826-4106-8bc0-7552eb44e99b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:42.310399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 840/1700] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:42.310399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0e90-9aef-449b-898c-53f40ae99d15 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:42.310399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0e90-9aef-449b-898c-53f40ae99d15 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:42.310399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0e90-9aef-449b-898c-53f40ae99d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:42.319369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c644bbf-e694-402f-812d-4d2e58fda3fa admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:42.330279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b37a3-8326-4dfe-ba37-c109d08b985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:42.331898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b37a3-8326-4dfe-ba37-c109d08b985b admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:42.332438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b37a3-8326-4dfe-ba37-c109d08b985b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:42.332752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b37a3-8326-4dfe-ba37-c109d08b985b admin admin] PATH_INFO: `/v3/projects/52d42309a6b744d3ad023f25355deed6/users/f734e7ce23c248a0a4dfb55fbea10b74/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:42.350012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b37a3-8326-4dfe-ba37-c109d08b985b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d42309a6b744d3ad023f25355deed6, user_id=f734e7ce23c248a0a4dfb55fbea10b74, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:42.360856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b37a3-8326-4dfe-ba37-c109d08b985b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:42.369093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-844f0e90-9aef-449b-898c-53f40ae99d15 None None] MFA Rules not processed for user `352a102f604048138df5a31bab4f8cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:42.370678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-844f0e90-9aef-449b-898c-53f40ae99d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:42.397291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 861/1701] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:42 2022] PUT /identity/v3/projects/52d42309a6b744d3ad023f25355deed6/users/f734e7ce23c248a0a4dfb55fbea10b74/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:42.397291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bde645-1846-4842-a999-86c60f80f184 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:42.397291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bde645-1846-4842-a999-86c60f80f184 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:42.397291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bde645-1846-4842-a999-86c60f80f184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:42.422910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-15bde645-1846-4842-a999-86c60f80f184 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:42.424386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-15bde645-1846-4842-a999-86c60f80f184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:42.447207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:42.453237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:42.501622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 841/1702] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:42.508596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f0e90-9aef-449b-898c-53f40ae99d15 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:42.510357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-844f0e90-9aef-449b-898c-53f40ae99d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:42.511597 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 862/1703] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:42.512690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bde645-1846-4842-a999-86c60f80f184 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:42.522757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bde645-1846-4842-a999-86c60f80f184 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:42.529474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fa7f6-4fdb-45ad-8226-b5a62c73f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:42.530107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fa7f6-4fdb-45ad-8226-b5a62c73f4af admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:42.530390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fa7f6-4fdb-45ad-8226-b5a62c73f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:42.530680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fa7f6-4fdb-45ad-8226-b5a62c73f4af admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:42.531375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fa7f6-4fdb-45ad-8226-b5a62c73f4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:42.533010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fa7f6-4fdb-45ad-8226-b5a62c73f4af admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:42.548218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 863/1704] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:42.549169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fa7f6-4fdb-45ad-8226-b5a62c73f4af admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:42.550943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-057fa7f6-4fdb-45ad-8226-b5a62c73f4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:42.568762 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fa7f6-4fdb-45ad-8226-b5a62c73f4af admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:42.576148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:42.576972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:42.577319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:42.577715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] PATH_INFO: `/v3/projects/1c6c4e83c69449059a7dc3297e7dd1a3` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:42.580461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6c4e83c69449059a7dc3297e7dd1a3)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:42.584162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:42.615178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f0e90-9aef-449b-898c-53f40ae99d15 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:42.677774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6c4e83c69449059a7dc3297e7dd1a3', 'request_id': 'req-aa0b7957-eb71-428e-b705-7c6bb74facc3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.690249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6c4e83c69449059a7dc3297e7dd1a3', 'request_id': 'req-aa0b7957-eb71-428e-b705-7c6bb74facc3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.705472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6c4e83c69449059a7dc3297e7dd1a3', 'request_id': 'req-aa0b7957-eb71-428e-b705-7c6bb74facc3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.721531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d5c69-0c4a-4503-beb3-5103fe3a9499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:42.722805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d5c69-0c4a-4503-beb3-5103fe3a9499 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:42.723222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d5c69-0c4a-4503-beb3-5103fe3a9499 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:42.723903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d5c69-0c4a-4503-beb3-5103fe3a9499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:42.730367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] The token cache is being invalidate because project 1c6c4e83c69449059a7dc3297e7dd1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:42.730938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.732322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aa0b7957-eb71-428e-b705-7c6bb74facc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:42.739795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 864/1705] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:42 2022] DELETE /identity/v3/projects/1c6c4e83c69449059a7dc3297e7dd1a3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:42.739795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2db03-e0d7-48f1-8600-bc188e2c4bd9 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:42.739795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2db03-e0d7-48f1-8600-bc188e2c4bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:42.739795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2db03-e0d7-48f1-8600-bc188e2c4bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:42.744029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d5c69-0c4a-4503-beb3-5103fe3a9499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:42.749307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d5c69-0c4a-4503-beb3-5103fe3a9499 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:42.778303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8bf2db03-e0d7-48f1-8600-bc188e2c4bd9 None None] MFA Rules not processed for user `f734e7ce23c248a0a4dfb55fbea10b74`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:42.779865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8bf2db03-e0d7-48f1-8600-bc188e2c4bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:42.783348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 842/1706] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:42.785302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d5c69-0c4a-4503-beb3-5103fe3a9499 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:42.788401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-232d5c69-0c4a-4503-beb3-5103fe3a9499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:43.004492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 865/1707] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:43.007090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620eebd-c8df-483e-ae1e-dedb9794eeed None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.007380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620eebd-c8df-483e-ae1e-dedb9794eeed None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.007642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620eebd-c8df-483e-ae1e-dedb9794eeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.014413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d5c69-0c4a-4503-beb3-5103fe3a9499 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:43.059284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5620eebd-c8df-483e-ae1e-dedb9794eeed None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:43.068453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5620eebd-c8df-483e-ae1e-dedb9794eeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:43.114181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:43.116810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:43.199188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaaac0-afef-4ae9-a916-7e61cb717a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:43.200206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaaac0-afef-4ae9-a916-7e61cb717a6e service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.201322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaaac0-afef-4ae9-a916-7e61cb717a6e service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.201664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaaac0-afef-4ae9-a916-7e61cb717a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.220149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5cbaaac0-afef-4ae9-a916-7e61cb717a6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:43.255606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 866/1708] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:43.258197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620eebd-c8df-483e-ae1e-dedb9794eeed None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:43.263173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5620eebd-c8df-483e-ae1e-dedb9794eeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:43.312509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620eebd-c8df-483e-ae1e-dedb9794eeed None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:43.327570 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c169139-16ad-4463-adc9-3dfbb4fc2620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:43.328192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c169139-16ad-4463-adc9-3dfbb4fc2620 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.328439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c169139-16ad-4463-adc9-3dfbb4fc2620 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.328540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaaac0-afef-4ae9-a916-7e61cb717a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:43.328705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c169139-16ad-4463-adc9-3dfbb4fc2620 admin admin] PATH_INFO: `/v3/projects/26fc1dc50c63428cbeca9351d8b40692/users/cbc978bdad444cbb8d8e258bb4100c5d/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.330174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaaac0-afef-4ae9-a916-7e61cb717a6e service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:43.344547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 843/1709] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:43.348002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb040b4-1f28-4ce2-a6ed-c7d8f29dad98 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.348310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb040b4-1f28-4ce2-a6ed-c7d8f29dad98 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.348586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb040b4-1f28-4ce2-a6ed-c7d8f29dad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.375159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9eb040b4-1f28-4ce2-a6ed-c7d8f29dad98 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:43.375947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c169139-16ad-4463-adc9-3dfbb4fc2620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fc1dc50c63428cbeca9351d8b40692, user_id=cbc978bdad444cbb8d8e258bb4100c5d, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:43.376692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9eb040b4-1f28-4ce2-a6ed-c7d8f29dad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:43.378689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c169139-16ad-4463-adc9-3dfbb4fc2620 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:43.388487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 844/1710] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:43.389388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb040b4-1f28-4ce2-a6ed-c7d8f29dad98 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:43.390929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9eb040b4-1f28-4ce2-a6ed-c7d8f29dad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:43.414033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 867/1711] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:43 2022] PUT /identity/v3/projects/26fc1dc50c63428cbeca9351d8b40692/users/cbc978bdad444cbb8d8e258bb4100c5d/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:43.427524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c169139-16ad-4463-adc9-3dfbb4fc2620 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:43.430214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0c169139-16ad-4463-adc9-3dfbb4fc2620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:43.520886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb040b4-1f28-4ce2-a6ed-c7d8f29dad98 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:43.555582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c169139-16ad-4463-adc9-3dfbb4fc2620 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:43.564043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:43.564991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.565376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.565779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] PATH_INFO: `/v3/projects/4d453e76f81247b7be347cea35241fd0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.567382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d453e76f81247b7be347cea35241fd0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:43.569813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:43.658750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d453e76f81247b7be347cea35241fd0', 'request_id': 'req-1a9d7480-909a-467b-9d28-43fb96d9799e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:43.668609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d453e76f81247b7be347cea35241fd0', 'request_id': 'req-1a9d7480-909a-467b-9d28-43fb96d9799e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:43.682088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d453e76f81247b7be347cea35241fd0', 'request_id': 'req-1a9d7480-909a-467b-9d28-43fb96d9799e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:43.685828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410f6f3-3b3a-41f6-bbcd-3d462554cfdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:43.686471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410f6f3-3b3a-41f6-bbcd-3d462554cfdf service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.686752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410f6f3-3b3a-41f6-bbcd-3d462554cfdf service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.687060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410f6f3-3b3a-41f6-bbcd-3d462554cfdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.718662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] The token cache is being invalidate because project 4d453e76f81247b7be347cea35241fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:43.721351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:43.722240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:43.727276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 868/1712] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:43 2022] DELETE /identity/v3/projects/4d453e76f81247b7be347cea35241fd0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:43.733997 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:43.739527 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:43.788378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:43.805167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:43.844278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410f6f3-3b3a-41f6-bbcd-3d462554cfdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:43.845772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410f6f3-3b3a-41f6-bbcd-3d462554cfdf service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:43.874683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 845/1713] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:43.880141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea91c-a913-42ff-8ae8-8aa1a9b6e046 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.880802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea91c-a913-42ff-8ae8-8aa1a9b6e046 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.881442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea91c-a913-42ff-8ae8-8aa1a9b6e046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.915266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d64ea91c-a913-42ff-8ae8-8aa1a9b6e046 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:43.920837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d64ea91c-a913-42ff-8ae8-8aa1a9b6e046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:43.923728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d7480-909a-467b-9d28-43fb96d9799e admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:43.937873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 846/1714] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:43.942905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97996284-6d23-436c-80d5-1b3575152c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:43.943545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996284-6d23-436c-80d5-1b3575152c22 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.943827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996284-6d23-436c-80d5-1b3575152c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.944100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996284-6d23-436c-80d5-1b3575152c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.944543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713eb98-0522-472e-b5c8-222a001f7362 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.944760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97996284-6d23-436c-80d5-1b3575152c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:43.944857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713eb98-0522-472e-b5c8-222a001f7362 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.945063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97996284-6d23-436c-80d5-1b3575152c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:43.945157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713eb98-0522-472e-b5c8-222a001f7362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.946694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97996284-6d23-436c-80d5-1b3575152c22 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:43.965870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 869/1715] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:43.967313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d7949-1c02-4d38-bf71-9e5cafa49ae5 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:43.967605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d7949-1c02-4d38-bf71-9e5cafa49ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:43.967884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d7949-1c02-4d38-bf71-9e5cafa49ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:43.997872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c60d7949-1c02-4d38-bf71-9e5cafa49ae5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:43.999685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c60d7949-1c02-4d38-bf71-9e5cafa49ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:44.010425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 870/1716] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:44.011399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d7949-1c02-4d38-bf71-9e5cafa49ae5 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:44.024210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d7949-1c02-4d38-bf71-9e5cafa49ae5 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:44.030033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d8ce5-3744-437e-8c7a-c52c38db5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:44.030668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d8ce5-3744-437e-8c7a-c52c38db5f86 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:44.030986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d8ce5-3744-437e-8c7a-c52c38db5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:44.031304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d8ce5-3744-437e-8c7a-c52c38db5f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:44.032149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d8ce5-3744-437e-8c7a-c52c38db5f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:44.032316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d8ce5-3744-437e-8c7a-c52c38db5f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:44.034612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d8ce5-3744-437e-8c7a-c52c38db5f86 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:44.054032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 871/1717] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:44.054032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d8ce5-3744-437e-8c7a-c52c38db5f86 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:44.056098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4713eb98-0522-472e-b5c8-222a001f7362 None None] MFA Rules not processed for user `cbc978bdad444cbb8d8e258bb4100c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:44.058537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4713eb98-0522-472e-b5c8-222a001f7362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:44.065067 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d8ce5-3744-437e-8c7a-c52c38db5f86 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:44.071691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338fe56-6c8c-4007-9c06-06f4b50fe61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:44.072485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338fe56-6c8c-4007-9c06-06f4b50fe61f admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:44.074613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338fe56-6c8c-4007-9c06-06f4b50fe61f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:44.075918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338fe56-6c8c-4007-9c06-06f4b50fe61f admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:44.076654 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338fe56-6c8c-4007-9c06-06f4b50fe61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:44.079924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338fe56-6c8c-4007-9c06-06f4b50fe61f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:44.139169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 872/1718] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:44 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:44.139169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5da23-1cc0-404e-b7c8-69f269cdfc7b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:44.139169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5da23-1cc0-404e-b7c8-69f269cdfc7b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:44.139169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5da23-1cc0-404e-b7c8-69f269cdfc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:44.177661 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e3c5da23-1cc0-404e-b7c8-69f269cdfc7b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:44.184838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e3c5da23-1cc0-404e-b7c8-69f269cdfc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:44.284280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 847/1719] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:44.287046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713eb98-0522-472e-b5c8-222a001f7362 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:44.316750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713eb98-0522-472e-b5c8-222a001f7362 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:44.377539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 873/1720] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:44.377539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5da23-1cc0-404e-b7c8-69f269cdfc7b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:44.397018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5da23-1cc0-404e-b7c8-69f269cdfc7b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:44.409663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df207cdb-4dba-4625-b3ef-28e8e5f30412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:44.410324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df207cdb-4dba-4625-b3ef-28e8e5f30412 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:44.410611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df207cdb-4dba-4625-b3ef-28e8e5f30412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:44.410954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df207cdb-4dba-4625-b3ef-28e8e5f30412 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:44.412391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df207cdb-4dba-4625-b3ef-28e8e5f30412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:44.422411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df207cdb-4dba-4625-b3ef-28e8e5f30412 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:44.477312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 874/1721] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:44 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:44.482158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcbd55-bdbb-4a4e-93f8-9f3dce3fed82 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:44.482446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcbd55-bdbb-4a4e-93f8-9f3dce3fed82 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:44.483867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcbd55-bdbb-4a4e-93f8-9f3dce3fed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:44.493309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c713-842e-404b-903d-0d33cf21c024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:44.494343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c713-842e-404b-903d-0d33cf21c024 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:44.494884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c713-842e-404b-903d-0d33cf21c024 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:44.495434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c713-842e-404b-903d-0d33cf21c024 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:44.496650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4c713-842e-404b-903d-0d33cf21c024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:44.499124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4c713-842e-404b-903d-0d33cf21c024 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:44.556986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 848/1722] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:44 2022] POST /identity/v3/projects => generated 381 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:44.560007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c713-842e-404b-903d-0d33cf21c024 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:44.566191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cdf4c713-842e-404b-903d-0d33cf21c024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:44.608452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-dbdcbd55-bdbb-4a4e-93f8-9f3dce3fed82 None None] MFA Rules not processed for user `f3d50a4d32b0479da61ccd26ff894197`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:44.613432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-dbdcbd55-bdbb-4a4e-93f8-9f3dce3fed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:44.778239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:44.781910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:44.833709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c713-842e-404b-903d-0d33cf21c024 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:44.844603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52556b0-e233-41d7-8c0c-8023b3abbf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:44.845761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52556b0-e233-41d7-8c0c-8023b3abbf47 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:44.846220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52556b0-e233-41d7-8c0c-8023b3abbf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:44.846631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52556b0-e233-41d7-8c0c-8023b3abbf47 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:44.847489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52556b0-e233-41d7-8c0c-8023b3abbf47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:44.849706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52556b0-e233-41d7-8c0c-8023b3abbf47 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:44.853333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 875/1723] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:44.853333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcbd55-bdbb-4a4e-93f8-9f3dce3fed82 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:44.907641 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 849/1724] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:44 2022] POST /identity/v3/projects => generated 387 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:44.909653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52556b0-e233-41d7-8c0c-8023b3abbf47 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:44.919184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcbd55-bdbb-4a4e-93f8-9f3dce3fed82 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:45.001001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52556b0-e233-41d7-8c0c-8023b3abbf47 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:45.007180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b09b8-58c4-479d-905e-037f087d566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:45.007818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b09b8-58c4-479d-905e-037f087d566c admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.008097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b09b8-58c4-479d-905e-037f087d566c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.008371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b09b8-58c4-479d-905e-037f087d566c admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.009434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b09b8-58c4-479d-905e-037f087d566c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:45.012071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b09b8-58c4-479d-905e-037f087d566c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:45.025900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 850/1725] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:45.027516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b09b8-58c4-479d-905e-037f087d566c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:45.040405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b09b8-58c4-479d-905e-037f087d566c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:45.051858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ec20d-312d-4016-800e-69748236fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:45.054630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ec20d-312d-4016-800e-69748236fd19 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.054951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ec20d-312d-4016-800e-69748236fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.055230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ec20d-312d-4016-800e-69748236fd19 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.060350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ec20d-312d-4016-800e-69748236fd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:45.067438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ec20d-312d-4016-800e-69748236fd19 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:45.148791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 851/1726] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:45 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:45.152896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d6ceb-00fe-441e-85e5-f95105282aaa None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.153197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d6ceb-00fe-441e-85e5-f95105282aaa None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.155199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d6ceb-00fe-441e-85e5-f95105282aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.159746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e24bc1-27ab-4299-ad82-9223b3ce9c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:45.160146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e24bc1-27ab-4299-ad82-9223b3ce9c15 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.160434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e24bc1-27ab-4299-ad82-9223b3ce9c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.160710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e24bc1-27ab-4299-ad82-9223b3ce9c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.161388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e24bc1-27ab-4299-ad82-9223b3ce9c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:45.161800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e24bc1-27ab-4299-ad82-9223b3ce9c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:45.163347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e24bc1-27ab-4299-ad82-9223b3ce9c15 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:45.207182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 876/1727] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:45.207962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e24bc1-27ab-4299-ad82-9223b3ce9c15 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:45.226214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-361d6ceb-00fe-441e-85e5-f95105282aaa None None] MFA Rules not processed for user `f3d50a4d32b0479da61ccd26ff894197`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:45.232343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e24bc1-27ab-4299-ad82-9223b3ce9c15 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:45.232519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-361d6ceb-00fe-441e-85e5-f95105282aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:45.243720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b118d-c441-4cd5-b8ea-a5dc761dda4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:45.245091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b118d-c441-4cd5-b8ea-a5dc761dda4a admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.246986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b118d-c441-4cd5-b8ea-a5dc761dda4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.246986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b118d-c441-4cd5-b8ea-a5dc761dda4a admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.247471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b118d-c441-4cd5-b8ea-a5dc761dda4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:45.251803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b118d-c441-4cd5-b8ea-a5dc761dda4a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:45.319712 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 877/1728] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:45 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:45.320674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b118d-c441-4cd5-b8ea-a5dc761dda4a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:45.354328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b118d-c441-4cd5-b8ea-a5dc761dda4a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:45.373336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a694913-7c7c-4779-aacb-0e46a7bc2115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:45.374583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a694913-7c7c-4779-aacb-0e46a7bc2115 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.374897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a694913-7c7c-4779-aacb-0e46a7bc2115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.375172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a694913-7c7c-4779-aacb-0e46a7bc2115 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.377948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a694913-7c7c-4779-aacb-0e46a7bc2115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:45.379612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a694913-7c7c-4779-aacb-0e46a7bc2115 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:45.419755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 852/1729] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:45.420966 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d6ceb-00fe-441e-85e5-f95105282aaa None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:45.440967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 878/1730] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:45.442308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a694913-7c7c-4779-aacb-0e46a7bc2115 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:45.459900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d6ceb-00fe-441e-85e5-f95105282aaa None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:45.463377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8a694913-7c7c-4779-aacb-0e46a7bc2115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:45.489169 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bf5db-7db0-48d6-9ae7-fa3d42e81b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:45.489743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bf5db-7db0-48d6-9ae7-fa3d42e81b24 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.490030 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bf5db-7db0-48d6-9ae7-fa3d42e81b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.490306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bf5db-7db0-48d6-9ae7-fa3d42e81b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.491105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bf5db-7db0-48d6-9ae7-fa3d42e81b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:45.492856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bf5db-7db0-48d6-9ae7-fa3d42e81b24 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:45.551183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 853/1731] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:45.553564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bf5db-7db0-48d6-9ae7-fa3d42e81b24 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:45.582949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bf5db-7db0-48d6-9ae7-fa3d42e81b24 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:45.591703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6ad70-eae4-4b84-b7c8-0723828d88fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:45.593363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ad70-eae4-4b84-b7c8-0723828d88fc admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.593792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ad70-eae4-4b84-b7c8-0723828d88fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.594218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ad70-eae4-4b84-b7c8-0723828d88fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.595028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6ad70-eae4-4b84-b7c8-0723828d88fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:45.621779 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6ad70-eae4-4b84-b7c8-0723828d88fc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:45.700558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a694913-7c7c-4779-aacb-0e46a7bc2115 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:45.701111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 854/1732] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:45 2022] POST /identity/v3/projects => generated 357 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:45.702062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6ad70-eae4-4b84-b7c8-0723828d88fc admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:45.752827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:45.804453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896155d-6913-4bf9-9a21-a508a29bb70a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:45.805163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896155d-6913-4bf9-9a21-a508a29bb70a service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.805509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896155d-6913-4bf9-9a21-a508a29bb70a service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.806492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896155d-6913-4bf9-9a21-a508a29bb70a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.812191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2896155d-6913-4bf9-9a21-a508a29bb70a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:45.875542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6ad70-eae4-4b84-b7c8-0723828d88fc admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:45.882142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839934a4-c537-4bd4-90c6-d836f718273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:45.883215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839934a4-c537-4bd4-90c6-d836f718273f admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.883607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839934a4-c537-4bd4-90c6-d836f718273f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.884263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839934a4-c537-4bd4-90c6-d836f718273f admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.885127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839934a4-c537-4bd4-90c6-d836f718273f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:45.887526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839934a4-c537-4bd4-90c6-d836f718273f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:45.895770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:45.908204 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 855/1733] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:45.909867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839934a4-c537-4bd4-90c6-d836f718273f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:45.912155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-839934a4-c537-4bd4-90c6-d836f718273f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:45.967938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896155d-6913-4bf9-9a21-a508a29bb70a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:45.969337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896155d-6913-4bf9-9a21-a508a29bb70a service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:45.996682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 879/1734] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:45.997555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896155d-6913-4bf9-9a21-a508a29bb70a service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:46.025724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896155d-6913-4bf9-9a21-a508a29bb70a service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:46.044717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40977ada-aec8-4e6a-b8dc-8347ffa59be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:46.045412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40977ada-aec8-4e6a-b8dc-8347ffa59be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.045688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40977ada-aec8-4e6a-b8dc-8347ffa59be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.045959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40977ada-aec8-4e6a-b8dc-8347ffa59be9 admin admin] PATH_INFO: `/v3/projects/80ca71a62121492aa200f3ef79c89db7/users/edefda09da1b438ea6f83fafd217fcf1/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.086349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40977ada-aec8-4e6a-b8dc-8347ffa59be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ca71a62121492aa200f3ef79c89db7, user_id=edefda09da1b438ea6f83fafd217fcf1, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:46.091711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40977ada-aec8-4e6a-b8dc-8347ffa59be9 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:46.103587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839934a4-c537-4bd4-90c6-d836f718273f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:46.134260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 880/1735] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:45 2022] PUT /identity/v3/projects/80ca71a62121492aa200f3ef79c89db7/users/edefda09da1b438ea6f83fafd217fcf1/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:46.134447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17ed0-4e8d-40df-99ce-2ddcda21981f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:46.134447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17ed0-4e8d-40df-99ce-2ddcda21981f service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.135445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40977ada-aec8-4e6a-b8dc-8347ffa59be9 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:46.164468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17ed0-4e8d-40df-99ce-2ddcda21981f service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.165539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17ed0-4e8d-40df-99ce-2ddcda21981f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.300718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40977ada-aec8-4e6a-b8dc-8347ffa59be9 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:46.316652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d28a-b15a-44d5-bbf3-db3f2bf82ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:46.317291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d28a-b15a-44d5-bbf3-db3f2bf82ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.317568 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d28a-b15a-44d5-bbf3-db3f2bf82ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.317839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d28a-b15a-44d5-bbf3-db3f2bf82ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.318487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d28a-b15a-44d5-bbf3-db3f2bf82ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:46.320370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d28a-b15a-44d5-bbf3-db3f2bf82ec7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:46.343755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 881/1736] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:46.344741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d28a-b15a-44d5-bbf3-db3f2bf82ec7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:46.366262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17ed0-4e8d-40df-99ce-2ddcda21981f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:46.369225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17ed0-4e8d-40df-99ce-2ddcda21981f service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:46.372524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d28a-b15a-44d5-bbf3-db3f2bf82ec7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:46.388097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec14638-ef51-4319-80be-fb8cbeed81d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:46.388644 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec14638-ef51-4319-80be-fb8cbeed81d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.388918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec14638-ef51-4319-80be-fb8cbeed81d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.389188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec14638-ef51-4319-80be-fb8cbeed81d0 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.389829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec14638-ef51-4319-80be-fb8cbeed81d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:46.392325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 856/1737] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:46.396060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17ed0-4e8d-40df-99ce-2ddcda21981f service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:46.403198 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec14638-ef51-4319-80be-fb8cbeed81d0 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:46.429581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17ed0-4e8d-40df-99ce-2ddcda21981f service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:46.452088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd61fb-e7fb-4065-93eb-668c794d8486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:46.456568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd61fb-e7fb-4065-93eb-668c794d8486 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.456909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd61fb-e7fb-4065-93eb-668c794d8486 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.457184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd61fb-e7fb-4065-93eb-668c794d8486 admin admin] PATH_INFO: `/v3/projects/d3d5eb91d85a43a4b147ce5d58d4f5dd/users/5a43d31a652e4c9cb995284fb44863a3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.476691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 882/1738] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:46 2022] POST /identity/v3/users => generated 279 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:46.478183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27924825-0c7f-49f7-9de6-97c5cd0b413c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.485055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27924825-0c7f-49f7-9de6-97c5cd0b413c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.485736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27924825-0c7f-49f7-9de6-97c5cd0b413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.530755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd61fb-e7fb-4065-93eb-668c794d8486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d5eb91d85a43a4b147ce5d58d4f5dd, user_id=5a43d31a652e4c9cb995284fb44863a3, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:46.536608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd61fb-e7fb-4065-93eb-668c794d8486 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:46.582636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 857/1739] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:46 2022] PUT /identity/v3/projects/d3d5eb91d85a43a4b147ce5d58d4f5dd/users/5a43d31a652e4c9cb995284fb44863a3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:46.583746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd61fb-e7fb-4065-93eb-668c794d8486 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:46.593498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-27924825-0c7f-49f7-9de6-97c5cd0b413c None None] MFA Rules not processed for user `edefda09da1b438ea6f83fafd217fcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:46.593498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-27924825-0c7f-49f7-9de6-97c5cd0b413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:46.699229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:46.795163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd61fb-e7fb-4065-93eb-668c794d8486 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:46.823611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedc9c4-b974-4166-a714-740b4cacb392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:46.824321 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedc9c4-b974-4166-a714-740b4cacb392 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.824600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedc9c4-b974-4166-a714-740b4cacb392 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.827156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 883/1740] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:46.828158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27924825-0c7f-49f7-9de6-97c5cd0b413c None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:46.828881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedc9c4-b974-4166-a714-740b4cacb392 admin admin] PATH_INFO: `/v3/projects/4b5e0d35434446c1bd6769ad842b63e1/users/96f687fc076c4e7ca3c540079f1ec80c/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.866279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27924825-0c7f-49f7-9de6-97c5cd0b413c None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:46.873419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedc9c4-b974-4166-a714-740b4cacb392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5e0d35434446c1bd6769ad842b63e1, user_id=96f687fc076c4e7ca3c540079f1ec80c, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:46.878691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedc9c4-b974-4166-a714-740b4cacb392 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:46.882664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec6345-1d0b-4641-90f5-1dc0eee9532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:46.884241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec6345-1d0b-4641-90f5-1dc0eee9532b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.884548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec6345-1d0b-4641-90f5-1dc0eee9532b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.884876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec6345-1d0b-4641-90f5-1dc0eee9532b admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.885549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec6345-1d0b-4641-90f5-1dc0eee9532b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:46.890868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec6345-1d0b-4641-90f5-1dc0eee9532b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:46.907430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:46.921954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 858/1741] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:46 2022] PUT /identity/v3/projects/4b5e0d35434446c1bd6769ad842b63e1/users/96f687fc076c4e7ca3c540079f1ec80c/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:46.921954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedc9c4-b974-4166-a714-740b4cacb392 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:46.924392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 884/1742] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:46.925294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec6345-1d0b-4641-90f5-1dc0eee9532b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:46.929854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-22ec6345-1d0b-4641-90f5-1dc0eee9532b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:47.111014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedc9c4-b974-4166-a714-740b4cacb392 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:47.111014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35671fc-a030-4c64-965d-6ef5031ba7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:47.111481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec6345-1d0b-4641-90f5-1dc0eee9532b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:47.111558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35671fc-a030-4c64-965d-6ef5031ba7df admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.111558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35671fc-a030-4c64-965d-6ef5031ba7df admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.111558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35671fc-a030-4c64-965d-6ef5031ba7df admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:47.111558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35671fc-a030-4c64-965d-6ef5031ba7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:47.111558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35671fc-a030-4c64-965d-6ef5031ba7df admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:47.126052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 859/1743] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:47.127641 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348f92c-aac2-4395-bdc6-0c5822d2d49d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.127929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348f92c-aac2-4395-bdc6-0c5822d2d49d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.128205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348f92c-aac2-4395-bdc6-0c5822d2d49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:47.175848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8348f92c-aac2-4395-bdc6-0c5822d2d49d None None] MFA Rules not processed for user `96f687fc076c4e7ca3c540079f1ec80c`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:47.177182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8348f92c-aac2-4395-bdc6-0c5822d2d49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:47.250367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f31a-c561-41f9-82b0-adbcf7b07b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:47.250967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f31a-c561-41f9-82b0-adbcf7b07b4d service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.251248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f31a-c561-41f9-82b0-adbcf7b07b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.251709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f31a-c561-41f9-82b0-adbcf7b07b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:47.332761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 860/1744] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:47.332761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348f92c-aac2-4395-bdc6-0c5822d2d49d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:47.381523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348f92c-aac2-4395-bdc6-0c5822d2d49d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:47.398662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db7fde-b84f-4289-934f-ae2c0ac21c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:47.399487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db7fde-b84f-4289-934f-ae2c0ac21c62 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.399953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db7fde-b84f-4289-934f-ae2c0ac21c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.400298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db7fde-b84f-4289-934f-ae2c0ac21c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:47.403280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db7fde-b84f-4289-934f-ae2c0ac21c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:47.406938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db7fde-b84f-4289-934f-ae2c0ac21c62 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:47.418955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f31a-c561-41f9-82b0-adbcf7b07b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:47.421556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f31a-c561-41f9-82b0-adbcf7b07b4d service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:47.430851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 861/1745] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:47.433924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db7fde-b84f-4289-934f-ae2c0ac21c62 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:47.443852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 885/1746] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:47.445643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4df6-5a8e-47ec-b515-1b3477f96990 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.446250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4df6-5a8e-47ec-b515-1b3477f96990 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.446725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4df6-5a8e-47ec-b515-1b3477f96990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:47.450557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db7fde-b84f-4289-934f-ae2c0ac21c62 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:47.460796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11efe7f-4724-4d93-95f9-ae171a03ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:47.462076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efe7f-4724-4d93-95f9-ae171a03ce93 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.464817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efe7f-4724-4d93-95f9-ae171a03ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.465112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11efe7f-4724-4d93-95f9-ae171a03ce93 admin admin] PATH_INFO: `/v3/projects/d3d5eb91d85a43a4b147ce5d58d4f5dd/users/5a43d31a652e4c9cb995284fb44863a3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:47.471154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11efe7f-4724-4d93-95f9-ae171a03ce93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d5eb91d85a43a4b147ce5d58d4f5dd, user_id=5a43d31a652e4c9cb995284fb44863a3, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:47.477863 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11efe7f-4724-4d93-95f9-ae171a03ce93 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:47.496074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1a4d4df6-5a8e-47ec-b515-1b3477f96990 None None] MFA Rules not processed for user `352a102f604048138df5a31bab4f8cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:47.499806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1a4d4df6-5a8e-47ec-b515-1b3477f96990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:47.522352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 862/1747] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:47 2022] PUT /identity/v3/projects/d3d5eb91d85a43a4b147ce5d58d4f5dd/users/5a43d31a652e4c9cb995284fb44863a3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:47.524509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11efe7f-4724-4d93-95f9-ae171a03ce93 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:47.562588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:47.663860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 886/1748] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:47.666254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29339039-496f-4ef0-946e-ac7773008ce2 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.666928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29339039-496f-4ef0-946e-ac7773008ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.667370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29339039-496f-4ef0-946e-ac7773008ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:47.669106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11efe7f-4724-4d93-95f9-ae171a03ce93 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:47.679635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbe95c-775c-4d16-98cb-5c06bdfecdfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:47.680440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbe95c-775c-4d16-98cb-5c06bdfecdfa service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.680723 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbe95c-775c-4d16-98cb-5c06bdfecdfa service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.680993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbe95c-775c-4d16-98cb-5c06bdfecdfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:47.765420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-29339039-496f-4ef0-946e-ac7773008ce2 None None] MFA Rules not processed for user `5d210b7348594c3da477a1b6b77dfb34`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:47.771028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-29339039-496f-4ef0-946e-ac7773008ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:47.788612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:47.845692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbe95c-775c-4d16-98cb-5c06bdfecdfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:47.847292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbe95c-775c-4d16-98cb-5c06bdfecdfa service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:47.859554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 863/1749] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:47.860565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbe95c-775c-4d16-98cb-5c06bdfecdfa service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:47.973180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbe95c-775c-4d16-98cb-5c06bdfecdfa service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:47.981303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 887/1750] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:47.991908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0daed-591b-43a3-a6ee-7813a9712eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:47.992045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea44321-82cc-41e9-9c49-be4f0ffae304 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.992369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea44321-82cc-41e9-9c49-be4f0ffae304 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.992728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea44321-82cc-41e9-9c49-be4f0ffae304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:47.993482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0daed-591b-43a3-a6ee-7813a9712eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:47.994085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0daed-591b-43a3-a6ee-7813a9712eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:47.995688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0daed-591b-43a3-a6ee-7813a9712eb0 admin admin] PATH_INFO: `/v3/projects/8654ca6e6e984434aebb5f921ab94dc4/users/08596361d0284822aa89afa02a41b325/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.032003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3ea44321-82cc-41e9-9c49-be4f0ffae304 None None] MFA Rules not processed for user `5a43d31a652e4c9cb995284fb44863a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:48.033552 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3ea44321-82cc-41e9-9c49-be4f0ffae304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.037052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0daed-591b-43a3-a6ee-7813a9712eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8654ca6e6e984434aebb5f921ab94dc4, user_id=08596361d0284822aa89afa02a41b325, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:48.050271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0daed-591b-43a3-a6ee-7813a9712eb0 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:48.067513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 864/1751] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:47 2022] PUT /identity/v3/projects/8654ca6e6e984434aebb5f921ab94dc4/users/08596361d0284822aa89afa02a41b325/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:48.069250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeeaac3-9460-4f2b-a7a5-92d4fb60d259 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.071186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeeaac3-9460-4f2b-a7a5-92d4fb60d259 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.071828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeeaac3-9460-4f2b-a7a5-92d4fb60d259 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.085001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 865/1752] 10.222.0.65 () {54 vars in 912 bytes} [Thu Aug 18 20:47:48 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:48.085887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeeaac3-9460-4f2b-a7a5-92d4fb60d259 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:48.198482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:48.234712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeeaac3-9460-4f2b-a7a5-92d4fb60d259 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:48.245024 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 888/1753] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:48.251730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:48.252246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.252403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d920-06bd-4279-b9b1-29d29ec47b29 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.252768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d920-06bd-4279-b9b1-29d29ec47b29 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.252887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.253058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] PATH_INFO: `/v3/users/96f687fc076c4e7ca3c540079f1ec80c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.253310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d920-06bd-4279-b9b1-29d29ec47b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.255301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f687fc076c4e7ca3c540079f1ec80c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:48.256861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:48.321947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-2543d920-06bd-4279-b9b1-29d29ec47b29 None None] MFA Rules not processed for user `5d210b7348594c3da477a1b6b77dfb34`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:48.324119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2543d920-06bd-4279-b9b1-29d29ec47b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.374695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f687fc076c4e7ca3c540079f1ec80c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:48.396398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f687fc076c4e7ca3c540079f1ec80c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:48.418109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f687fc076c4e7ca3c540079f1ec80c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:48.452426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f687fc076c4e7ca3c540079f1ec80c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:48.454080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-49cae6c3-8380-4dac-b669-100e45cd7113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f687fc076c4e7ca3c540079f1ec80c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:48.469458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 866/1754] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:48 2022] DELETE /identity/v3/users/96f687fc076c4e7ca3c540079f1ec80c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:48.473805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b88ff-613b-47da-a7cd-9754167f31e1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.474095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b88ff-613b-47da-a7cd-9754167f31e1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.474380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b88ff-613b-47da-a7cd-9754167f31e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.482150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 889/1755] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:48.483614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439d00-9f73-4bff-b799-53dbb3b4c93b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.483901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439d00-9f73-4bff-b799-53dbb3b4c93b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.484172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439d00-9f73-4bff-b799-53dbb3b4c93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.542731 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c43b88ff-613b-47da-a7cd-9754167f31e1 None None] MFA Rules not processed for user `08596361d0284822aa89afa02a41b325`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:48.551968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c43b88ff-613b-47da-a7cd-9754167f31e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.584828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d5439d00-9f73-4bff-b799-53dbb3b4c93b None None] MFA Rules not processed for user `c13c571a4bd24335b8b149825bd79d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:48.587547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d5439d00-9f73-4bff-b799-53dbb3b4c93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.614699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:48.667967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 890/1756] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:47:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:48.669057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 867/1757] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:48.670304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2507b-528a-4934-955a-31f561c7315b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.670593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2507b-528a-4934-955a-31f561c7315b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.670927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2507b-528a-4934-955a-31f561c7315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.683437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5439d00-9f73-4bff-b799-53dbb3b4c93b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:48.685224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d5439d00-9f73-4bff-b799-53dbb3b4c93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.695868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a3e2507b-528a-4934-955a-31f561c7315b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:48.697338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a3e2507b-528a-4934-955a-31f561c7315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.761252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:48.772845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5439d00-9f73-4bff-b799-53dbb3b4c93b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:48.776704 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 868/1758] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:48.778196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6e74-d114-408e-8238-b9dc8c933bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:48.778578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fb7f2-f198-40ff-a85e-ab10053f4722 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.779197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6e74-d114-408e-8238-b9dc8c933bcf service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.779618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6e74-d114-408e-8238-b9dc8c933bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.779747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fb7f2-f198-40ff-a85e-ab10053f4722 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.780072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fb7f2-f198-40ff-a85e-ab10053f4722 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.780282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6e74-d114-408e-8238-b9dc8c933bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.782455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e89e6e74-d114-408e-8238-b9dc8c933bcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.783423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 869/1759] 10.222.0.65 () {54 vars in 912 bytes} [Thu Aug 18 20:47:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:48.784215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fb7f2-f198-40ff-a85e-ab10053f4722 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:48.786841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-517fb7f2-f198-40ff-a85e-ab10053f4722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.813209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fb7f2-f198-40ff-a85e-ab10053f4722 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:48.818295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496e5bf-0095-4cae-bed5-9b558a634129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:48.819080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e5bf-0095-4cae-bed5-9b558a634129 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.819206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e5bf-0095-4cae-bed5-9b558a634129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.819482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e5bf-0095-4cae-bed5-9b558a634129 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.820236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496e5bf-0095-4cae-bed5-9b558a634129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:48.822199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496e5bf-0095-4cae-bed5-9b558a634129 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:48.872214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 870/1760] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:48 2022] POST /identity/v3/projects => generated 357 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:48.874137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496e5bf-0095-4cae-bed5-9b558a634129 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:48.883164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c496e5bf-0095-4cae-bed5-9b558a634129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.895235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6e74-d114-408e-8238-b9dc8c933bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:48.896881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6e74-d114-408e-8238-b9dc8c933bcf service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:48.911542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 891/1761] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:48.912927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b12ae-b18f-4621-84c0-b250b6c313bb None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.913578 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b12ae-b18f-4621-84c0-b250b6c313bb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.913857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b12ae-b18f-4621-84c0-b250b6c313bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.940144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-4c3b12ae-b18f-4621-84c0-b250b6c313bb None None] MFA Rules not processed for user `c13c571a4bd24335b8b149825bd79d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:48.941378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4c3b12ae-b18f-4621-84c0-b250b6c313bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:48.972820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496e5bf-0095-4cae-bed5-9b558a634129 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:48.977583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320d26-fb53-4934-9ac4-ae3408b3ad5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:48.978317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320d26-fb53-4934-9ac4-ae3408b3ad5c service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.979046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320d26-fb53-4934-9ac4-ae3408b3ad5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.979972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320d26-fb53-4934-9ac4-ae3408b3ad5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.989826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac320d26-fb53-4934-9ac4-ae3408b3ad5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:48.991589 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac320d26-fb53-4934-9ac4-ae3408b3ad5c service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:49.002627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 871/1762] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:49.014891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 892/1763] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:47:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:49.016410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b12ae-b18f-4621-84c0-b250b6c313bb None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:49.024625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320d26-fb53-4934-9ac4-ae3408b3ad5c service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:49.027772 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b12ae-b18f-4621-84c0-b250b6c313bb None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:49.039726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb997be-ebe0-4983-91ea-f7993ed8f0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:49.040465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb997be-ebe0-4983-91ea-f7993ed8f0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:49.040808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb997be-ebe0-4983-91ea-f7993ed8f0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:49.041016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb997be-ebe0-4983-91ea-f7993ed8f0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:49.126102 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:49.227690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb997be-ebe0-4983-91ea-f7993ed8f0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:49.229930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb997be-ebe0-4983-91ea-f7993ed8f0b3 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:49.246250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 893/1764] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:49.247402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb997be-ebe0-4983-91ea-f7993ed8f0b3 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:49.248962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0fb997be-ebe0-4983-91ea-f7993ed8f0b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:49.262613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320d26-fb53-4934-9ac4-ae3408b3ad5c service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:49.265435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb997be-ebe0-4983-91ea-f7993ed8f0b3 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:49.271277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:49.271930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:49.272207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:49.273942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] PATH_INFO: `/v3/users/cbc978bdad444cbb8d8e258bb4100c5d` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:49.277476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d92be-23e7-4354-91c8-d9d271369778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:49.278157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d92be-23e7-4354-91c8-d9d271369778 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:49.278384 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d92be-23e7-4354-91c8-d9d271369778 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:49.278654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d92be-23e7-4354-91c8-d9d271369778 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:49.280327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc978bdad444cbb8d8e258bb4100c5d)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:49.282329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:49.283734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d92be-23e7-4354-91c8-d9d271369778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:49.286180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d92be-23e7-4354-91c8-d9d271369778 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:49.336611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 872/1765] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:49 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:49.337548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d92be-23e7-4354-91c8-d9d271369778 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:49.364778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d92be-23e7-4354-91c8-d9d271369778 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:49.374217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de091462-9f22-4414-88e9-0cfbc64b8170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:49.375495 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de091462-9f22-4414-88e9-0cfbc64b8170 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:49.377000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de091462-9f22-4414-88e9-0cfbc64b8170 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:49.377000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de091462-9f22-4414-88e9-0cfbc64b8170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:49.393868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de091462-9f22-4414-88e9-0cfbc64b8170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:49.395400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de091462-9f22-4414-88e9-0cfbc64b8170 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:49.397366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc978bdad444cbb8d8e258bb4100c5d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:49.399244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc978bdad444cbb8d8e258bb4100c5d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:49.423698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 873/1766] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:49.424606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de091462-9f22-4414-88e9-0cfbc64b8170 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:49.432344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc978bdad444cbb8d8e258bb4100c5d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:49.451060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc978bdad444cbb8d8e258bb4100c5d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:49.452074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8eaa01f5-08ca-4d10-aa49-bb744609ca05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc978bdad444cbb8d8e258bb4100c5d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:49.454315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de091462-9f22-4414-88e9-0cfbc64b8170 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:49.471510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2725e-6b81-4253-83d7-1f3e55f7a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:49.471831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2725e-6b81-4253-83d7-1f3e55f7a2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:49.472115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2725e-6b81-4253-83d7-1f3e55f7a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:49.474473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2725e-6b81-4253-83d7-1f3e55f7a2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:49.475200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2725e-6b81-4253-83d7-1f3e55f7a2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:49.476851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2725e-6b81-4253-83d7-1f3e55f7a2c8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:49.490369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 894/1767] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:49 2022] DELETE /identity/v3/users/cbc978bdad444cbb8d8e258bb4100c5d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:49.492197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bce7b-41f2-4c07-8777-938d1ea8f4f4 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:49.495032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bce7b-41f2-4c07-8777-938d1ea8f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:49.495183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bce7b-41f2-4c07-8777-938d1ea8f4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:49.505608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 874/1768] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:49.511928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2725e-6b81-4253-83d7-1f3e55f7a2c8 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:49.517136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bff2725e-6b81-4253-83d7-1f3e55f7a2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:49.556252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-054bce7b-41f2-4c07-8777-938d1ea8f4f4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:49.564162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-054bce7b-41f2-4c07-8777-938d1ea8f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:49.570627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2725e-6b81-4253-83d7-1f3e55f7a2c8 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:49.714646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 895/1769] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:49.722052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bce7b-41f2-4c07-8777-938d1ea8f4f4 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:49.727319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-054bce7b-41f2-4c07-8777-938d1ea8f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:49.735090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:49.793660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6ed21-415d-4380-b5d5-9a1e9f233a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:49.794970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6ed21-415d-4380-b5d5-9a1e9f233a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:49.795905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6ed21-415d-4380-b5d5-9a1e9f233a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:49.797244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6ed21-415d-4380-b5d5-9a1e9f233a5d admin admin] PATH_INFO: `/v3/projects/2e278873591c4f1ab876ccf10fde4a1c/users/327797c02b5b48279a7956ddfaaad844/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:49.844840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:49.852007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6ed21-415d-4380-b5d5-9a1e9f233a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e278873591c4f1ab876ccf10fde4a1c, user_id=327797c02b5b48279a7956ddfaaad844, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:49.862206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6ed21-415d-4380-b5d5-9a1e9f233a5d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:49.893464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 875/1770] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:49 2022] PUT /identity/v3/projects/2e278873591c4f1ab876ccf10fde4a1c/users/327797c02b5b48279a7956ddfaaad844/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:49.899545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6ed21-415d-4380-b5d5-9a1e9f233a5d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:49.899727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bce7b-41f2-4c07-8777-938d1ea8f4f4 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:50.077492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9257-39c6-4e20-bcf9-fb6b43113879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:50.079498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9257-39c6-4e20-bcf9-fb6b43113879 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:50.080174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9257-39c6-4e20-bcf9-fb6b43113879 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:50.080174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9257-39c6-4e20-bcf9-fb6b43113879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:50.118760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6ed21-415d-4380-b5d5-9a1e9f233a5d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:50.124818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf9257-39c6-4e20-bcf9-fb6b43113879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:50.126346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf9257-39c6-4e20-bcf9-fb6b43113879 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:50.143848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324247d-9cf4-4316-89d3-c57a2f3b9d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:50.144633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324247d-9cf4-4316-89d3-c57a2f3b9d1b admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:50.144918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324247d-9cf4-4316-89d3-c57a2f3b9d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:50.145242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324247d-9cf4-4316-89d3-c57a2f3b9d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:50.146426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324247d-9cf4-4316-89d3-c57a2f3b9d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:50.148247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324247d-9cf4-4316-89d3-c57a2f3b9d1b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:50.162266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 896/1771] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:50.163194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9257-39c6-4e20-bcf9-fb6b43113879 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:50.178440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4ebf9257-39c6-4e20-bcf9-fb6b43113879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:50.208060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 876/1772] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:50.209049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324247d-9cf4-4316-89d3-c57a2f3b9d1b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:50.269566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324247d-9cf4-4316-89d3-c57a2f3b9d1b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:50.284398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea34dc3-a4ac-4993-9445-e98c91e8f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:50.287316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea34dc3-a4ac-4993-9445-e98c91e8f9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:50.287599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea34dc3-a4ac-4993-9445-e98c91e8f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:50.287876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea34dc3-a4ac-4993-9445-e98c91e8f9a7 admin admin] PATH_INFO: `/v3/projects/2e278873591c4f1ab876ccf10fde4a1c/users/327797c02b5b48279a7956ddfaaad844/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:50.298577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea34dc3-a4ac-4993-9445-e98c91e8f9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e278873591c4f1ab876ccf10fde4a1c, user_id=327797c02b5b48279a7956ddfaaad844, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:50.308240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea34dc3-a4ac-4993-9445-e98c91e8f9a7 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:50.348375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 877/1773] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:50 2022] PUT /identity/v3/projects/2e278873591c4f1ab876ccf10fde4a1c/users/327797c02b5b48279a7956ddfaaad844/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:50.353644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab450d4-f481-4651-b191-5990aad680cf None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:50.354750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab450d4-f481-4651-b191-5990aad680cf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:50.356906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab450d4-f481-4651-b191-5990aad680cf None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:50.365208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 878/1774] 10.222.0.65 () {54 vars in 961 bytes} [Thu Aug 18 20:47:50 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:50.368780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82a71-66b6-4254-8cf9-6328b65ae1ea None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:50.370469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82a71-66b6-4254-8cf9-6328b65ae1ea None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:50.371730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82a71-66b6-4254-8cf9-6328b65ae1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:50.414295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9257-39c6-4e20-bcf9-fb6b43113879 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:50.483055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-72b82a71-66b6-4254-8cf9-6328b65ae1ea None None] MFA Rules not processed for user `327797c02b5b48279a7956ddfaaad844`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:50.484703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-72b82a71-66b6-4254-8cf9-6328b65ae1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:50.583980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:50.584624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:50.584906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:50.585343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:50.595531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:50.684533 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 879/1775] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:50.686044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f6e8-7937-44a4-8aff-373878070b41 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:50.690870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f6e8-7937-44a4-8aff-373878070b41 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:50.691257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f6e8-7937-44a4-8aff-373878070b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:50.697660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:50.731395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9b64f6e8-7937-44a4-8aff-373878070b41 None None] MFA Rules not processed for user `be696635db224e3a868957eb5b5bae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:50.732984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9b64f6e8-7937-44a4-8aff-373878070b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:50.776659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:50.778535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:50.807012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:50.811768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 897/1776] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:50.812420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:50.819026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:50.913492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 880/1777] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Aug 18 20:47:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:50.914519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64f6e8-7937-44a4-8aff-373878070b41 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:50.920259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9b64f6e8-7937-44a4-8aff-373878070b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:51.030395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bde18d-5116-48f8-a923-52c597941111 service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:51.046738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:51.047595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.047984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.048368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] PATH_INFO: `/v3/projects/4b5e0d35434446c1bd6769ad842b63e1` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.051410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5e0d35434446c1bd6769ad842b63e1)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:51.053504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:51.060136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64f6e8-7937-44a4-8aff-373878070b41 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:51.070922 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe4ccf-6fe7-420c-b370-33cb3976edb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:51.071706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe4ccf-6fe7-420c-b370-33cb3976edb2 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.072095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe4ccf-6fe7-420c-b370-33cb3976edb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.072518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe4ccf-6fe7-420c-b370-33cb3976edb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.099062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe4ccf-6fe7-420c-b370-33cb3976edb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:51.103330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe4ccf-6fe7-420c-b370-33cb3976edb2 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:51.138435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 881/1778] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:51.139895 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe4ccf-6fe7-420c-b370-33cb3976edb2 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:51.164212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe4ccf-6fe7-420c-b370-33cb3976edb2 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:51.184044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5e0d35434446c1bd6769ad842b63e1', 'request_id': 'req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:51.195680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5e0d35434446c1bd6769ad842b63e1', 'request_id': 'req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:51.215902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5e0d35434446c1bd6769ad842b63e1', 'request_id': 'req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:51.236570 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] The token cache is being invalidate because project 4b5e0d35434446c1bd6769ad842b63e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:51.237051 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:51.238464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:51.244321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 898/1779] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:50 2022] DELETE /identity/v3/projects/4b5e0d35434446c1bd6769ad842b63e1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:51.247342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:51.256218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:51.315167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11361a8e-0bba-491f-9042-5e4ea4e04a2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:51.315757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361a8e-0bba-491f-9042-5e4ea4e04a2c service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.316041 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361a8e-0bba-491f-9042-5e4ea4e04a2c service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.316318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361a8e-0bba-491f-9042-5e4ea4e04a2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.322196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-11361a8e-0bba-491f-9042-5e4ea4e04a2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:51.346374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361a8e-0bba-491f-9042-5e4ea4e04a2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:51.348106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361a8e-0bba-491f-9042-5e4ea4e04a2c service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:51.375860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 882/1780] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:51.377371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8a065-27af-4173-b912-0cddd4869f04 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.377679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8a065-27af-4173-b912-0cddd4869f04 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.377942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8a065-27af-4173-b912-0cddd4869f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.437074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-66c8a065-27af-4173-b912-0cddd4869f04 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:51.438325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-66c8a065-27af-4173-b912-0cddd4869f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:51.462196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:51.475842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92620fd6-8300-4c2e-90c6-4fe8dacdbd6a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:51.496122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d52205-3303-4d3d-93d8-420d84a4ac67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:51.496856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d52205-3303-4d3d-93d8-420d84a4ac67 service placement] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.497186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d52205-3303-4d3d-93d8-420d84a4ac67 service placement] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.497480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d52205-3303-4d3d-93d8-420d84a4ac67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.516672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d52205-3303-4d3d-93d8-420d84a4ac67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:51.518371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d52205-3303-4d3d-93d8-420d84a4ac67 service placement] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:51.548038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 899/1781] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:51.549586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d52205-3303-4d3d-93d8-420d84a4ac67 service placement] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:51.563631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-67d52205-3303-4d3d-93d8-420d84a4ac67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:51.568837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 883/1782] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:51.570283 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db904-5591-4006-b813-0780ad37433b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.583254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db904-5591-4006-b813-0780ad37433b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.583254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db904-5591-4006-b813-0780ad37433b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.593305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:51.619093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ad5db904-5591-4006-b813-0780ad37433b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:51.620874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ad5db904-5591-4006-b813-0780ad37433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:51.654591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 884/1783] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:51.656348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5db904-5591-4006-b813-0780ad37433b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:51.674588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5db904-5591-4006-b813-0780ad37433b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:51.683042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae609e-2e0d-4f40-bbaf-064b61061c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:51.683677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae609e-2e0d-4f40-bbaf-064b61061c89 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.683963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae609e-2e0d-4f40-bbaf-064b61061c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.684239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae609e-2e0d-4f40-bbaf-064b61061c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.684961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae609e-2e0d-4f40-bbaf-064b61061c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:51.697591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae609e-2e0d-4f40-bbaf-064b61061c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:51.701502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae609e-2e0d-4f40-bbaf-064b61061c89 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:51.747180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 885/1784] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:51.748137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae609e-2e0d-4f40-bbaf-064b61061c89 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:51.750601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d52205-3303-4d3d-93d8-420d84a4ac67 service placement] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:51.763047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd233b9-faf9-4e91-afb1-d15e241cfb53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:51.763683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd233b9-faf9-4e91-afb1-d15e241cfb53 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.763961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd233b9-faf9-4e91-afb1-d15e241cfb53 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.764230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd233b9-faf9-4e91-afb1-d15e241cfb53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.767906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae609e-2e0d-4f40-bbaf-064b61061c89 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:51.769310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1fd233b9-faf9-4e91-afb1-d15e241cfb53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:51.786562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b756-db7f-48f1-8640-4bdbd5ed39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:51.787226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b756-db7f-48f1-8640-4bdbd5ed39ed admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.787509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b756-db7f-48f1-8640-4bdbd5ed39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.788219 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b756-db7f-48f1-8640-4bdbd5ed39ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.789208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9b756-db7f-48f1-8640-4bdbd5ed39ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:51.795364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9b756-db7f-48f1-8640-4bdbd5ed39ed admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:51.873490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 886/1785] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:51 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:51.876422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b756-db7f-48f1-8640-4bdbd5ed39ed admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:51.929178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd233b9-faf9-4e91-afb1-d15e241cfb53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:51.932192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd233b9-faf9-4e91-afb1-d15e241cfb53 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:51.961759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 900/1786] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:51.999839 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b756-db7f-48f1-8640-4bdbd5ed39ed admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:52.019463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9710a98-b4ac-47cf-9d73-902743955941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:52.020102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9710a98-b4ac-47cf-9d73-902743955941 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:52.020382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9710a98-b4ac-47cf-9d73-902743955941 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:52.020655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9710a98-b4ac-47cf-9d73-902743955941 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:52.021285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9710a98-b4ac-47cf-9d73-902743955941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:52.023272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9710a98-b4ac-47cf-9d73-902743955941 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:52.083796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 887/1787] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:51 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:52.090385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd233b9-faf9-4e91-afb1-d15e241cfb53 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:52.111229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9710a98-b4ac-47cf-9d73-902743955941 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:52.114592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f9710a98-b4ac-47cf-9d73-902743955941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:52.115984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd233b9-faf9-4e91-afb1-d15e241cfb53 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:52.133460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a51623-c92b-41f6-b765-68bfdf24f709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:52.134390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51623-c92b-41f6-b765-68bfdf24f709 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:52.134603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51623-c92b-41f6-b765-68bfdf24f709 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:52.134899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51623-c92b-41f6-b765-68bfdf24f709 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:52.135781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a51623-c92b-41f6-b765-68bfdf24f709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:52.144612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a51623-c92b-41f6-b765-68bfdf24f709 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:52.153851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9710a98-b4ac-47cf-9d73-902743955941 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:52.169057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 901/1788] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:52.172889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a51623-c92b-41f6-b765-68bfdf24f709 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:52.181130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:52.181982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:52.186575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:52.192227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] PATH_INFO: `/v3/projects/26fc1dc50c63428cbeca9351d8b40692` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:52.196703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fc1dc50c63428cbeca9351d8b40692)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:52.203256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a51623-c92b-41f6-b765-68bfdf24f709 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:52.206934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:52.208670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d9b30-01c6-4c77-b6bf-87a8d695e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:52.209295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d9b30-01c6-4c77-b6bf-87a8d695e14f admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:52.209583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d9b30-01c6-4c77-b6bf-87a8d695e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:52.209851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d9b30-01c6-4c77-b6bf-87a8d695e14f admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:52.210502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d9b30-01c6-4c77-b6bf-87a8d695e14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:52.212417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d9b30-01c6-4c77-b6bf-87a8d695e14f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:52.255961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 902/1789] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:52.256269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d9b30-01c6-4c77-b6bf-87a8d695e14f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:52.281167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d9b30-01c6-4c77-b6bf-87a8d695e14f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:52.304362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0648f6-74fd-4f5a-bf70-47b0e8ea3f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:52.305049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0648f6-74fd-4f5a-bf70-47b0e8ea3f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:52.305332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0648f6-74fd-4f5a-bf70-47b0e8ea3f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:52.305608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0648f6-74fd-4f5a-bf70-47b0e8ea3f2c admin admin] PATH_INFO: `/v3/projects/d04e732b943f4853968b0f38403baea1/users/1184f47cf81a46658d47578e3776b211/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:52.337729 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0648f6-74fd-4f5a-bf70-47b0e8ea3f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04e732b943f4853968b0f38403baea1, user_id=1184f47cf81a46658d47578e3776b211, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:52.341519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0648f6-74fd-4f5a-bf70-47b0e8ea3f2c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:52.375329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 903/1790] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:52 2022] PUT /identity/v3/projects/d04e732b943f4853968b0f38403baea1/users/1184f47cf81a46658d47578e3776b211/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:52.388632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c1c57-cf84-4667-b413-e768b05126af None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:52.389123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c1c57-cf84-4667-b413-e768b05126af None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:52.389559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c1c57-cf84-4667-b413-e768b05126af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:52.428356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fc1dc50c63428cbeca9351d8b40692', 'request_id': 'req-87492c1f-5c85-424c-8da6-4a1ffed5ffca'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:52.444254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fc1dc50c63428cbeca9351d8b40692', 'request_id': 'req-87492c1f-5c85-424c-8da6-4a1ffed5ffca'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:52.468646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fc1dc50c63428cbeca9351d8b40692', 'request_id': 'req-87492c1f-5c85-424c-8da6-4a1ffed5ffca'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:52.475472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-275c1c57-cf84-4667-b413-e768b05126af None None] MFA Rules not processed for user `1184f47cf81a46658d47578e3776b211`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:52.476626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-275c1c57-cf84-4667-b413-e768b05126af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:52.483685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] The token cache is being invalidate because project 26fc1dc50c63428cbeca9351d8b40692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:52.484280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:52.485267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:52.488043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 888/1791] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:52 2022] DELETE /identity/v3/projects/26fc1dc50c63428cbeca9351d8b40692 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:47:52.502858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:52.509517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:52.617364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:52.664584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 904/1792] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:52.665651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c1c57-cf84-4667-b413-e768b05126af None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:52.670750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-275c1c57-cf84-4667-b413-e768b05126af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:52.711720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:52.775357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87492c1f-5c85-424c-8da6-4a1ffed5ffca admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:52.791274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:52.792719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:52.793172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:52.795237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] PATH_INFO: `/v3/users/5a43d31a652e4c9cb995284fb44863a3` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:52.800454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a43d31a652e4c9cb995284fb44863a3)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:52.802690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:52.821599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c1c57-cf84-4667-b413-e768b05126af None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:52.837156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:52.837718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:52.837999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:52.838316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:52.841045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:52.939018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a43d31a652e4c9cb995284fb44863a3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:52.965013 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a43d31a652e4c9cb995284fb44863a3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:53.003444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:53.004903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:53.020445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a43d31a652e4c9cb995284fb44863a3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:53.038421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 905/1793] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:53.042462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:53.045653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:53.083154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a43d31a652e4c9cb995284fb44863a3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:53.083973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-dbed1d13-e934-4f81-b57d-c07b07328896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a43d31a652e4c9cb995284fb44863a3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:53.115672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 889/1794] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:52 2022] DELETE /identity/v3/users/5a43d31a652e4c9cb995284fb44863a3 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:53.322471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aedeb6-ffc9-4e1d-9f46-6701cfd3db22 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:53.419784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:53.438836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d4e9baa7a6241b1807c67844c7d424c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:53.439848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:53.440333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:53.440837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:53.443226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:53.659171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:53.662687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:53.693421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 906/1795] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:53.781541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df567d-5dac-4135-ae78-b4049face9be None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:53.782012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df567d-5dac-4135-ae78-b4049face9be None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:53.782091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df567d-5dac-4135-ae78-b4049face9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:53.939959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b1df567d-5dac-4135-ae78-b4049face9be None None] MFA Rules not processed for user `5d210b7348594c3da477a1b6b77dfb34`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:53.946427 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b1df567d-5dac-4135-ae78-b4049face9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:54.154377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 890/1796] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:54.265470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:54.267544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:54.395980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4602951-f425-4936-a895-2f07c7abc537 service glance] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:54.403124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:54.404321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:54.404740 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:54.405310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] PATH_INFO: `/v3/projects/d3d5eb91d85a43a4b147ce5d58d4f5dd` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:54.407244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d5eb91d85a43a4b147ce5d58d4f5dd)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:54.410027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:54.501745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d5eb91d85a43a4b147ce5d58d4f5dd', 'request_id': 'req-ac44c18e-4033-497b-902c-9abc700e2d8a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:54.524698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d5eb91d85a43a4b147ce5d58d4f5dd', 'request_id': 'req-ac44c18e-4033-497b-902c-9abc700e2d8a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:54.540362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d5eb91d85a43a4b147ce5d58d4f5dd', 'request_id': 'req-ac44c18e-4033-497b-902c-9abc700e2d8a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:54.561907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] The token cache is being invalidate because project d3d5eb91d85a43a4b147ce5d58d4f5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:47:54.562832 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:54.564061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac44c18e-4033-497b-902c-9abc700e2d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:54.575789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863d50e-b682-4e27-8fa1-a58222047239 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:54.586577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863d50e-b682-4e27-8fa1-a58222047239 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:54.586577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863d50e-b682-4e27-8fa1-a58222047239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:54.586886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 907/1797] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:47:54 2022] DELETE /identity/v3/projects/d3d5eb91d85a43a4b147ce5d58d4f5dd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:54.679770 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1863d50e-b682-4e27-8fa1-a58222047239 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:54.685620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1863d50e-b682-4e27-8fa1-a58222047239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:54.866294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:54.901814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 891/1798] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:54.911463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64df9e-17cb-4ea1-bdfc-a6a1e0faac64 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:54.912165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64df9e-17cb-4ea1-bdfc-a6a1e0faac64 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:54.912594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64df9e-17cb-4ea1-bdfc-a6a1e0faac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:54.957765 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-9b64df9e-17cb-4ea1-bdfc-a6a1e0faac64 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:54.959263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9b64df9e-17cb-4ea1-bdfc-a6a1e0faac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:54.985577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 908/1799] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:54.990027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863d50e-b682-4e27-8fa1-a58222047239 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:55.004887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863d50e-b682-4e27-8fa1-a58222047239 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:55.016801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe89de2-7c57-473a-ad53-2cd6a6ac7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:55.017439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe89de2-7c57-473a-ad53-2cd6a6ac7132 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:55.017717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe89de2-7c57-473a-ad53-2cd6a6ac7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:55.017985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe89de2-7c57-473a-ad53-2cd6a6ac7132 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:55.018644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe89de2-7c57-473a-ad53-2cd6a6ac7132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:47:55.018978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe89de2-7c57-473a-ad53-2cd6a6ac7132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:55.020587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe89de2-7c57-473a-ad53-2cd6a6ac7132 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:55.052564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 892/1800] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:47:55.056993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64df9e-17cb-4ea1-bdfc-a6a1e0faac64 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:55.072260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64df9e-17cb-4ea1-bdfc-a6a1e0faac64 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:55.106656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b87253-2913-4656-9c6e-db40cf3d948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:55.109627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b87253-2913-4656-9c6e-db40cf3d948d admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:55.111003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b87253-2913-4656-9c6e-db40cf3d948d admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:55.111498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b87253-2913-4656-9c6e-db40cf3d948d admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:55.112294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b87253-2913-4656-9c6e-db40cf3d948d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:55.119168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b87253-2913-4656-9c6e-db40cf3d948d admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:55.174485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:55.205561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 909/1801] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:55 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:55.207258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe89de2-7c57-473a-ad53-2cd6a6ac7132 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:55.228494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe89de2-7c57-473a-ad53-2cd6a6ac7132 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:55.394479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba82d7-5d5a-4c8f-af60-15df8c2e4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:55.395353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba82d7-5d5a-4c8f-af60-15df8c2e4b08 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:55.395693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba82d7-5d5a-4c8f-af60-15df8c2e4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:55.396099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba82d7-5d5a-4c8f-af60-15df8c2e4b08 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:55.397523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba82d7-5d5a-4c8f-af60-15df8c2e4b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:55.399449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba82d7-5d5a-4c8f-af60-15df8c2e4b08 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:55.459935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 893/1802] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:55 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:55.463814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b87253-2913-4656-9c6e-db40cf3d948d admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:55.481316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b87253-2913-4656-9c6e-db40cf3d948d admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:55.487824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf5c26-49ad-4d3a-bf15-3c64d6b1bd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:55.488754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5c26-49ad-4d3a-bf15-3c64d6b1bd0b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:55.489192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5c26-49ad-4d3a-bf15-3c64d6b1bd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:55.489620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5c26-49ad-4d3a-bf15-3c64d6b1bd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:55.491185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5c26-49ad-4d3a-bf15-3c64d6b1bd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:55.492993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5c26-49ad-4d3a-bf15-3c64d6b1bd0b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:55.506999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 910/1803] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:55.510853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba82d7-5d5a-4c8f-af60-15df8c2e4b08 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:55.546828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba82d7-5d5a-4c8f-af60-15df8c2e4b08 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:55.566728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9ff49-ea13-4afb-adf1-4588181e71cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:55.569582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9ff49-ea13-4afb-adf1-4588181e71cf admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:55.569885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9ff49-ea13-4afb-adf1-4588181e71cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:55.570157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9ff49-ea13-4afb-adf1-4588181e71cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:55.577783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9ff49-ea13-4afb-adf1-4588181e71cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:55.579917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9ff49-ea13-4afb-adf1-4588181e71cf admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:55.608540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf5c26-49ad-4d3a-bf15-3c64d6b1bd0b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:55.619482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 894/1804] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:55.620751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf5c26-49ad-4d3a-bf15-3c64d6b1bd0b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:55.637002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546708cc-4f87-4fd1-ba74-c9b5f43d0786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:55.637730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546708cc-4f87-4fd1-ba74-c9b5f43d0786 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:55.637960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546708cc-4f87-4fd1-ba74-c9b5f43d0786 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:55.638235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546708cc-4f87-4fd1-ba74-c9b5f43d0786 admin admin] PATH_INFO: `/v3/projects/106c2b3709fe46c587943e3b6d85460a/users/597be1140bb3460c9c1b4798a0355757/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:55.684882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546708cc-4f87-4fd1-ba74-c9b5f43d0786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106c2b3709fe46c587943e3b6d85460a, user_id=597be1140bb3460c9c1b4798a0355757, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:55.700691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546708cc-4f87-4fd1-ba74-c9b5f43d0786 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:55.772760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 911/1805] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:55 2022] PUT /identity/v3/projects/106c2b3709fe46c587943e3b6d85460a/users/597be1140bb3460c9c1b4798a0355757/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:55.773463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff424ab-f8cf-41c1-902b-d072c5ce2272 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:55.773463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff424ab-f8cf-41c1-902b-d072c5ce2272 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:55.773463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff424ab-f8cf-41c1-902b-d072c5ce2272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:55.774758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c493a-6c63-496b-8312-06fec1a4b0cd None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:55.775075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c493a-6c63-496b-8312-06fec1a4b0cd None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:55.775355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c493a-6c63-496b-8312-06fec1a4b0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:55.920215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ba7c493a-6c63-496b-8312-06fec1a4b0cd None None] MFA Rules not processed for user `597be1140bb3460c9c1b4798a0355757`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:55.923666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ba7c493a-6c63-496b-8312-06fec1a4b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:55.933631 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3ff424ab-f8cf-41c1-902b-d072c5ce2272 None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:55.935507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3ff424ab-f8cf-41c1-902b-d072c5ce2272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:56.157924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 895/1806] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:47:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:56.234991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 912/1807] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:47:56.239592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff424ab-f8cf-41c1-902b-d072c5ce2272 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:56.368463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e402-eefd-49ce-8675-daaced8e5aba None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:56.368777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e402-eefd-49ce-8675-daaced8e5aba None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:56.369059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e402-eefd-49ce-8675-daaced8e5aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:56.369460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:56.411946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff424ab-f8cf-41c1-902b-d072c5ce2272 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:56.420520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e20eb-a168-4670-ad1a-f8f6eae9a825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:56.421756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e20eb-a168-4670-ad1a-f8f6eae9a825 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:56.422207 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e20eb-a168-4670-ad1a-f8f6eae9a825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:56.423620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e20eb-a168-4670-ad1a-f8f6eae9a825 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:56.424543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e20eb-a168-4670-ad1a-f8f6eae9a825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:56.427581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e20eb-a168-4670-ad1a-f8f6eae9a825 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:56.461027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-93f0e402-eefd-49ce-8675-daaced8e5aba None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:56.462291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-93f0e402-eefd-49ce-8675-daaced8e5aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:56.508477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 913/1808] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:47:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:47:56.516061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 896/1809] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:56 2022] POST /identity/v3/projects => generated 379 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:56.517781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e402-eefd-49ce-8675-daaced8e5aba None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:56.550757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e20eb-a168-4670-ad1a-f8f6eae9a825 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:56.553075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a71e20eb-a168-4670-ad1a-f8f6eae9a825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:56.558693 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e402-eefd-49ce-8675-daaced8e5aba None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:56.770812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ea29d-5680-4363-9238-b6a6cde93550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:56.771632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ea29d-5680-4363-9238-b6a6cde93550 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:56.772064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ea29d-5680-4363-9238-b6a6cde93550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:56.772646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ea29d-5680-4363-9238-b6a6cde93550 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:56.773740 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ea29d-5680-4363-9238-b6a6cde93550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:56.776103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ea29d-5680-4363-9238-b6a6cde93550 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:56.821241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 914/1810] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:56 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:56.822648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ea29d-5680-4363-9238-b6a6cde93550 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:56.828223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-950ea29d-5680-4363-9238-b6a6cde93550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:57.010930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e20eb-a168-4670-ad1a-f8f6eae9a825 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:57.025257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:57.087381 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7defeca-d65f-4653-89b9-a5b96e0b1598 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:57.092274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7defeca-d65f-4653-89b9-a5b96e0b1598 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:57.092571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7defeca-d65f-4653-89b9-a5b96e0b1598 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:57.092844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7defeca-d65f-4653-89b9-a5b96e0b1598 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:57.128324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ea29d-5680-4363-9238-b6a6cde93550 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:57.150938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7470987-3925-4281-9ddd-368e385480be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:57.153827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7470987-3925-4281-9ddd-368e385480be service swift] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:57.154203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7470987-3925-4281-9ddd-368e385480be service swift] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:57.155060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7470987-3925-4281-9ddd-368e385480be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:57.322327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7470987-3925-4281-9ddd-368e385480be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:57.326783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7470987-3925-4281-9ddd-368e385480be service swift] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:57.340665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 915/1811] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:47:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:47:57.341847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7470987-3925-4281-9ddd-368e385480be service swift] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:57.366398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7470987-3925-4281-9ddd-368e385480be service swift] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:57.369186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7defeca-d65f-4653-89b9-a5b96e0b1598 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:57.386119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7defeca-d65f-4653-89b9-a5b96e0b1598 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:57.399346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573924c-a2ca-45c6-82be-5b51953a8ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:57.401988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573924c-a2ca-45c6-82be-5b51953a8ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:57.402274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573924c-a2ca-45c6-82be-5b51953a8ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:57.403057 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573924c-a2ca-45c6-82be-5b51953a8ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:57.405128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573924c-a2ca-45c6-82be-5b51953a8ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:57.406802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573924c-a2ca-45c6-82be-5b51953a8ab5 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:57.424073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 897/1812] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:47:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 874 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:47:57.476915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 916/1813] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:57.479828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7defeca-d65f-4653-89b9-a5b96e0b1598 service swift] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:57.501040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7defeca-d65f-4653-89b9-a5b96e0b1598 service swift] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:57.517655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf0dfa-dac5-45ab-a4a4-5c236f5cc69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:57.518369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf0dfa-dac5-45ab-a4a4-5c236f5cc69b admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:57.518661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf0dfa-dac5-45ab-a4a4-5c236f5cc69b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:57.518970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf0dfa-dac5-45ab-a4a4-5c236f5cc69b admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:57.519686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf0dfa-dac5-45ab-a4a4-5c236f5cc69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:57.521772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf0dfa-dac5-45ab-a4a4-5c236f5cc69b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:57.550650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 898/1814] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:47:57.551953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573924c-a2ca-45c6-82be-5b51953a8ab5 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:57.574943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573924c-a2ca-45c6-82be-5b51953a8ab5 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:57.595968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c05648-5455-430e-a0da-7ebda1e71aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:57.596962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c05648-5455-430e-a0da-7ebda1e71aed admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:57.598752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c05648-5455-430e-a0da-7ebda1e71aed admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:57.599277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c05648-5455-430e-a0da-7ebda1e71aed admin admin] PATH_INFO: `/v3/projects/95aeccb6fd7c4296b9207d4ed47f67d9/users/688768d8b21d411f989490690209f83d/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:57.675169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c05648-5455-430e-a0da-7ebda1e71aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=95aeccb6fd7c4296b9207d4ed47f67d9, user_id=688768d8b21d411f989490690209f83d, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:57.684836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c05648-5455-430e-a0da-7ebda1e71aed admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:57.722214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 917/1815] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:57 2022] PUT /identity/v3/projects/95aeccb6fd7c4296b9207d4ed47f67d9/users/688768d8b21d411f989490690209f83d/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:57.735255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac377e-d3ea-420e-bef2-6e40cbfeb32a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:57.735722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac377e-d3ea-420e-bef2-6e40cbfeb32a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:57.737776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac377e-d3ea-420e-bef2-6e40cbfeb32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:57.957866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d3ac377e-d3ea-420e-bef2-6e40cbfeb32a None None] MFA Rules not processed for user `688768d8b21d411f989490690209f83d`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:57.957866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d3ac377e-d3ea-420e-bef2-6e40cbfeb32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:58.028182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:58.282142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 899/1816] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:58.287629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c05648-5455-430e-a0da-7ebda1e71aed admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:58.554066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c05648-5455-430e-a0da-7ebda1e71aed admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:58.568918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71794fd-c54d-47c8-a358-4cca0a4ab67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:58.570871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71794fd-c54d-47c8-a358-4cca0a4ab67b admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:58.573420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71794fd-c54d-47c8-a358-4cca0a4ab67b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:58.576782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71794fd-c54d-47c8-a358-4cca0a4ab67b admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:58.577714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71794fd-c54d-47c8-a358-4cca0a4ab67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:58.583667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71794fd-c54d-47c8-a358-4cca0a4ab67b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:58.687152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 918/1817] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:47:58 2022] POST /identity/v3/projects => generated 379 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:58.688844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac377e-d3ea-420e-bef2-6e40cbfeb32a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:58.707634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac377e-d3ea-420e-bef2-6e40cbfeb32a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:58.986009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356236b-255a-41e8-887f-8c384df25894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:58.986894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356236b-255a-41e8-887f-8c384df25894 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:58.987179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356236b-255a-41e8-887f-8c384df25894 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:58.988476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356236b-255a-41e8-887f-8c384df25894 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:58.989369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356236b-255a-41e8-887f-8c384df25894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:58.995470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356236b-255a-41e8-887f-8c384df25894 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:59.015749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71794fd-c54d-47c8-a358-4cca0a4ab67b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:59.019738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b71794fd-c54d-47c8-a358-4cca0a4ab67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:59.066091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71794fd-c54d-47c8-a358-4cca0a4ab67b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:59.069940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 900/1818] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:47:58 2022] POST /identity/v3/users => generated 296 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:47:59.072027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356236b-255a-41e8-887f-8c384df25894 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:59.086444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:59.087792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:59.088084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:59.090935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] PATH_INFO: `/v3/users/701297cde71940aca086669a89327051` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:59.095464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=701297cde71940aca086669a89327051)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:59.109633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:59.113132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356236b-255a-41e8-887f-8c384df25894 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:59.136836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96885e1b-5561-4107-a87e-5b8abd602e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:59.139125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96885e1b-5561-4107-a87e-5b8abd602e01 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:59.139464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96885e1b-5561-4107-a87e-5b8abd602e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:59.139671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96885e1b-5561-4107-a87e-5b8abd602e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:59.146640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96885e1b-5561-4107-a87e-5b8abd602e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:59.148335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96885e1b-5561-4107-a87e-5b8abd602e01 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:59.232606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 901/1819] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:59.238291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96885e1b-5561-4107-a87e-5b8abd602e01 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:59.240161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:59.331406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96885e1b-5561-4107-a87e-5b8abd602e01 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:59.349777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95566833-acf6-46f1-885e-d70ed7087d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:59.352109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95566833-acf6-46f1-885e-d70ed7087d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:59.364279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95566833-acf6-46f1-885e-d70ed7087d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:59.364643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95566833-acf6-46f1-885e-d70ed7087d10 admin admin] PATH_INFO: `/v3/projects/6081e49567484f81984b764ac0987bbe/users/838d13b92e104684a398f1db3f39abf3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:59.378358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '701297cde71940aca086669a89327051'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:59.382210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '701297cde71940aca086669a89327051'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:59.427187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95566833-acf6-46f1-885e-d70ed7087d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6081e49567484f81984b764ac0987bbe, user_id=838d13b92e104684a398f1db3f39abf3, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:59.432933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '701297cde71940aca086669a89327051'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:59.436796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95566833-acf6-46f1-885e-d70ed7087d10 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:59.458974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '701297cde71940aca086669a89327051'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:59.460287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1f77950f-0b52-4df7-baaf-cafaffe95733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '701297cde71940aca086669a89327051'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:47:59.507233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 902/1820] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:59 2022] PUT /identity/v3/projects/6081e49567484f81984b764ac0987bbe/users/838d13b92e104684a398f1db3f39abf3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:59.511693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95566833-acf6-46f1-885e-d70ed7087d10 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:59.518953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-95566833-acf6-46f1-885e-d70ed7087d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:59.520626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 919/1821] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:47:59 2022] DELETE /identity/v3/users/701297cde71940aca086669a89327051 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:47:59.524519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f8350-0d2d-4fa9-8dd7-db797eac0f9e None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:59.524792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f8350-0d2d-4fa9-8dd7-db797eac0f9e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:59.525067 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f8350-0d2d-4fa9-8dd7-db797eac0f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:59.602030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c35f8350-0d2d-4fa9-8dd7-db797eac0f9e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:59.606386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c35f8350-0d2d-4fa9-8dd7-db797eac0f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:59.726606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95566833-acf6-46f1-885e-d70ed7087d10 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:59.806599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:59.811494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 920/1822] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:47:59.880471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dc9f0-e0d8-4f9e-beb9-307dbbdd6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:59.881166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dc9f0-e0d8-4f9e-beb9-307dbbdd6d1d admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:59.881566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dc9f0-e0d8-4f9e-beb9-307dbbdd6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:59.881967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dc9f0-e0d8-4f9e-beb9-307dbbdd6d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:59.883047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940dc9f0-e0d8-4f9e-beb9-307dbbdd6d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:59.886655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940dc9f0-e0d8-4f9e-beb9-307dbbdd6d1d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:59.905198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 903/1823] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:59.909348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f8350-0d2d-4fa9-8dd7-db797eac0f9e None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:59.921095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dc9f0-e0d8-4f9e-beb9-307dbbdd6d1d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:59.933314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f8350-0d2d-4fa9-8dd7-db797eac0f9e None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:59.940370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-940dc9f0-e0d8-4f9e-beb9-307dbbdd6d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:59.958449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a84771-3db3-413f-b517-a35ce1fa19d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:59.959276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a84771-3db3-413f-b517-a35ce1fa19d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:59.964412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a84771-3db3-413f-b517-a35ce1fa19d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:59.965088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a84771-3db3-413f-b517-a35ce1fa19d1 admin admin] PATH_INFO: `/v3/projects/6081e49567484f81984b764ac0987bbe/users/838d13b92e104684a398f1db3f39abf3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:59.980985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a84771-3db3-413f-b517-a35ce1fa19d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6081e49567484f81984b764ac0987bbe, user_id=838d13b92e104684a398f1db3f39abf3, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:59.985149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a84771-3db3-413f-b517-a35ce1fa19d1 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:00.050892 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 921/1824] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:47:59 2022] PUT /identity/v3/projects/6081e49567484f81984b764ac0987bbe/users/838d13b92e104684a398f1db3f39abf3/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:00.069575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3ecfb-050a-4552-b2ce-bc0e78a0a5eb None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:00.073385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3ecfb-050a-4552-b2ce-bc0e78a0a5eb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:00.073789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3ecfb-050a-4552-b2ce-bc0e78a0a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:00.156905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-32c3ecfb-050a-4552-b2ce-bc0e78a0a5eb None None] MFA Rules not processed for user `838d13b92e104684a398f1db3f39abf3`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:00.158903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-32c3ecfb-050a-4552-b2ce-bc0e78a0a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:00.178949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dc9f0-e0d8-4f9e-beb9-307dbbdd6d1d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:00.464134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d6bf6-b8cb-4638-a5cf-41b8cb15e029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:00.464750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d6bf6-b8cb-4638-a5cf-41b8cb15e029 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:00.464987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d6bf6-b8cb-4638-a5cf-41b8cb15e029 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:00.465259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d6bf6-b8cb-4638-a5cf-41b8cb15e029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:00.552126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 922/1825] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:00.556565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4ac0-e626-4d5a-aab4-225a0e648523 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:00.557319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4ac0-e626-4d5a-aab4-225a0e648523 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:00.558430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4ac0-e626-4d5a-aab4-225a0e648523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:00.620999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-420f4ac0-e626-4d5a-aab4-225a0e648523 None None] MFA Rules not processed for user `c13c571a4bd24335b8b149825bd79d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:00.632339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-420f4ac0-e626-4d5a-aab4-225a0e648523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:00.663598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 923/1826] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Aug 18 20:48:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:00.665972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4ac0-e626-4d5a-aab4-225a0e648523 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:00.671999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-420f4ac0-e626-4d5a-aab4-225a0e648523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:00.687447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:00.711761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d6bf6-b8cb-4638-a5cf-41b8cb15e029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:00.713376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d6bf6-b8cb-4638-a5cf-41b8cb15e029 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:00.742143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 904/1827] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 821 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:00.750128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d6bf6-b8cb-4638-a5cf-41b8cb15e029 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:00.769072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d6bf6-b8cb-4638-a5cf-41b8cb15e029 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:00.781087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164a00-bc33-4338-bf07-2d0ae5747b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:00.781718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164a00-bc33-4338-bf07-2d0ae5747b0c service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:00.781993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164a00-bc33-4338-bf07-2d0ae5747b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:00.782262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164a00-bc33-4338-bf07-2d0ae5747b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:00.796904 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4ac0-e626-4d5a-aab4-225a0e648523 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:00.801520 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a9a3a-939b-4466-ab24-a8e1a7ec34ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:00.802409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a9a3a-939b-4466-ab24-a8e1a7ec34ad service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:00.802834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a9a3a-939b-4466-ab24-a8e1a7ec34ad service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:00.803215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a9a3a-939b-4466-ab24-a8e1a7ec34ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:00.805277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8164a00-bc33-4338-bf07-2d0ae5747b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:00.806733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8164a00-bc33-4338-bf07-2d0ae5747b0c service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:00.820264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a9a3a-939b-4466-ab24-a8e1a7ec34ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:00.820264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a9a3a-939b-4466-ab24-a8e1a7ec34ad service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:00.828132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 924/1828] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:00.829156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a9a3a-939b-4466-ab24-a8e1a7ec34ad service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:00.830588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d84a9a3a-939b-4466-ab24-a8e1a7ec34ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:00.831724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 905/1829] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:00.852525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a9a3a-939b-4466-ab24-a8e1a7ec34ad service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:00.864827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a6f0d-e05a-4295-a930-879e123d96a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:00.865275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a6f0d-e05a-4295-a930-879e123d96a3 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:00.865658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a6f0d-e05a-4295-a930-879e123d96a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:00.866036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a6f0d-e05a-4295-a930-879e123d96a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:00.899600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a6f0d-e05a-4295-a930-879e123d96a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:00.902756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a6f0d-e05a-4295-a930-879e123d96a3 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:00.929876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164a00-bc33-4338-bf07-2d0ae5747b0c service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:00.943011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 925/1830] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:00.950869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164a00-bc33-4338-bf07-2d0ae5747b0c service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:00.960706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:00.961579 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:00.964030 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:00.964482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:00.972662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:01.009394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:01.205575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:01.209748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:01.234141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 906/1831] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:03.445014 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c9ca0-ec8c-4bfe-a1a8-81f18a86df80 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:03.445600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c9ca0-ec8c-4bfe-a1a8-81f18a86df80 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:03.445795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c9ca0-ec8c-4bfe-a1a8-81f18a86df80 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:03.449871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 926/1832] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:48:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:48:03.516888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:03.518427 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:03.548242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61074fa9-af0f-47f2-a0b1-5cd6425cbcae service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:03.571559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:03.572224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:03.573213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:03.577038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] PATH_INFO: `/v3/users/edefda09da1b438ea6f83fafd217fcf1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:03.582299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edefda09da1b438ea6f83fafd217fcf1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:03.598890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:03.624245 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d77dd-d1ee-4ede-8f1c-e4a97d4dd629 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:03.624752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d77dd-d1ee-4ede-8f1c-e4a97d4dd629 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:03.625452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d77dd-d1ee-4ede-8f1c-e4a97d4dd629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:03.675841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-703d77dd-d1ee-4ede-8f1c-e4a97d4dd629 None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:03.687163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-703d77dd-d1ee-4ede-8f1c-e4a97d4dd629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:03.848055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edefda09da1b438ea6f83fafd217fcf1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:03.884708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edefda09da1b438ea6f83fafd217fcf1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:03.912550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edefda09da1b438ea6f83fafd217fcf1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:03.949125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 927/1833] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:48:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:03.973656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edefda09da1b438ea6f83fafd217fcf1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:03.977914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edefda09da1b438ea6f83fafd217fcf1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:03.997355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 907/1834] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:03 2022] DELETE /identity/v3/users/edefda09da1b438ea6f83fafd217fcf1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:04.005590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd616-f434-43cc-962a-2e36a1381cc9 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:04.006746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd616-f434-43cc-962a-2e36a1381cc9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:04.006746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd616-f434-43cc-962a-2e36a1381cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:04.038240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-16edd616-f434-43cc-962a-2e36a1381cc9 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:04.040344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-16edd616-f434-43cc-962a-2e36a1381cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:04.063233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:04.064436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:04.253239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 928/1835] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:04.265331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd616-f434-43cc-962a-2e36a1381cc9 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:04.269610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-16edd616-f434-43cc-962a-2e36a1381cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:04.273518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bb5d-1b24-4da9-bf78-50b0933a1845 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:04.301623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:04.303442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:04.304813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:04.305227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:04.309572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:04.321977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd616-f434-43cc-962a-2e36a1381cc9 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:04.337795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:04.339298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:04.341054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:04.341471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] PATH_INFO: `/v3/projects/0d65f3444a2b499c8c1d60f1b4b48b7e` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:04.358111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d65f3444a2b499c8c1d60f1b4b48b7e)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:04.360885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:04.362833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:04.367112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:04.401133 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 908/1836] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:04.403114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:04.405822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:04.429152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:04.488653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:04.590107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01729-57f3-4ea7-b1ad-a0200173f85e service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:04.661088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d65f3444a2b499c8c1d60f1b4b48b7e', 'request_id': 'req-90223368-9a4d-4866-8bba-7020551308c8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:04.682667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d65f3444a2b499c8c1d60f1b4b48b7e', 'request_id': 'req-90223368-9a4d-4866-8bba-7020551308c8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:04.696223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d65f3444a2b499c8c1d60f1b4b48b7e', 'request_id': 'req-90223368-9a4d-4866-8bba-7020551308c8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:04.730285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] The token cache is being invalidate because project 0d65f3444a2b499c8c1d60f1b4b48b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:04.731305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:04.735181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:04.741597 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 929/1837] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:04 2022] DELETE /identity/v3/projects/0d65f3444a2b499c8c1d60f1b4b48b7e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:04.747237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:04.751271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:04.815713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7c279-b17a-4fa1-8cf5-288848508f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:04.816415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7c279-b17a-4fa1-8cf5-288848508f77 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:04.816979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7c279-b17a-4fa1-8cf5-288848508f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:04.818109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7c279-b17a-4fa1-8cf5-288848508f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:04.837557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c4a7c279-b17a-4fa1-8cf5-288848508f77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:04.972477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90223368-9a4d-4866-8bba-7020551308c8 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:04.989988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:04.993690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:04.993690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:04.994021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] PATH_INFO: `/v3/users/7a4751af58e94a81809422241e0ac917` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:05.014608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4751af58e94a81809422241e0ac917)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:05.020166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:05.121600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7c279-b17a-4fa1-8cf5-288848508f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:05.129746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7c279-b17a-4fa1-8cf5-288848508f77 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:05.153171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 909/1838] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:05.234410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4751af58e94a81809422241e0ac917'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:05.236562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4751af58e94a81809422241e0ac917'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:05.292933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4751af58e94a81809422241e0ac917'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:05.312820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4751af58e94a81809422241e0ac917'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:05.316460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4751af58e94a81809422241e0ac917'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:05.337168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f3fe6-b8b9-4568-bb6d-92eed580240a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:05.337689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f3fe6-b8b9-4568-bb6d-92eed580240a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:05.338588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f3fe6-b8b9-4568-bb6d-92eed580240a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:05.340479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 910/1839] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:48:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:48:05.352560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 930/1840] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:04 2022] DELETE /identity/v3/users/7a4751af58e94a81809422241e0ac917 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:05.480420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3be68-3ab3-4f24-b0c4-178f02393b64 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:05.480816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3be68-3ab3-4f24-b0c4-178f02393b64 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:05.482609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3be68-3ab3-4f24-b0c4-178f02393b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:05.599602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4ed3be68-3ab3-4f24-b0c4-178f02393b64 None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:05.602331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4ed3be68-3ab3-4f24-b0c4-178f02393b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:05.654856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:05.657044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:05.742111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:05.828473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 911/1841] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:48:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:05.868900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385aeeeb-5e7c-43e5-a92c-b1447a8949c2 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:05.885684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:05.886585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:05.886991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:05.887290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] PATH_INFO: `/v3/users/597be1140bb3460c9c1b4798a0355757` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:05.888639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=597be1140bb3460c9c1b4798a0355757)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:05.890591 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:05.996894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597be1140bb3460c9c1b4798a0355757'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:05.998974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597be1140bb3460c9c1b4798a0355757'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:06.024845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597be1140bb3460c9c1b4798a0355757'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:06.042944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597be1140bb3460c9c1b4798a0355757'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:06.044103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597be1140bb3460c9c1b4798a0355757'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:06.070944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 931/1842] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:05 2022] DELETE /identity/v3/users/597be1140bb3460c9c1b4798a0355757 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:06.078124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0b037-1834-4ab0-b3a4-6b008ac50242 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:06.079247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0b037-1834-4ab0-b3a4-6b008ac50242 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:06.080453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0b037-1834-4ab0-b3a4-6b008ac50242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:06.095862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:06.103557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:06.124350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:06.131885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a1d0b037-1834-4ab0-b3a4-6b008ac50242 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:06.133531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a1d0b037-1834-4ab0-b3a4-6b008ac50242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:06.267768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 912/1843] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:06.353146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36984d-9382-4ce7-abe9-955099234631 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:06.359972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0b037-1834-4ab0-b3a4-6b008ac50242 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:06.361933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a1d0b037-1834-4ab0-b3a4-6b008ac50242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:06.384761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:06.386912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:06.387199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:06.387470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:06.390533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:06.421542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:06.429429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:06.475234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 932/1844] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:06.519163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0b037-1834-4ab0-b3a4-6b008ac50242 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:06.536696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1c25b-b8ca-4016-a195-ef896e9c5314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:06.537875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1c25b-b8ca-4016-a195-ef896e9c5314 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:06.538318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1c25b-b8ca-4016-a195-ef896e9c5314 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:06.538906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1c25b-b8ca-4016-a195-ef896e9c5314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:06.561728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1c25b-b8ca-4016-a195-ef896e9c5314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:06.566436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1c25b-b8ca-4016-a195-ef896e9c5314 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:06.596392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 913/1845] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:07.580877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:07.595471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:07.639464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb856a23-0590-4c4c-a068-900cd53df5be service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:07.659476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:07.663432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:07.664044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:07.664607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] PATH_INFO: `/v3/projects/80ca71a62121492aa200f3ef79c89db7` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:07.668810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ca71a62121492aa200f3ef79c89db7)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:07.671944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:07.785592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:07.843611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ca71a62121492aa200f3ef79c89db7', 'request_id': 'req-baf1e0e8-037e-4213-9537-c369a671187c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:07.875908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ca71a62121492aa200f3ef79c89db7', 'request_id': 'req-baf1e0e8-037e-4213-9537-c369a671187c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:07.887998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ca71a62121492aa200f3ef79c89db7', 'request_id': 'req-baf1e0e8-037e-4213-9537-c369a671187c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:07.909851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] The token cache is being invalidate because project 80ca71a62121492aa200f3ef79c89db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:07.910160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:07.914153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-baf1e0e8-037e-4213-9537-c369a671187c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:07.920119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 933/1846] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:07 2022] DELETE /identity/v3/projects/80ca71a62121492aa200f3ef79c89db7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:07.924718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34286c1-89aa-4f5a-ae77-4b51ba5d2ff6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:07.925576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34286c1-89aa-4f5a-ae77-4b51ba5d2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:07.925576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34286c1-89aa-4f5a-ae77-4b51ba5d2ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:07.954216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f34286c1-89aa-4f5a-ae77-4b51ba5d2ff6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:07.956120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f34286c1-89aa-4f5a-ae77-4b51ba5d2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:08.157002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 914/1847] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:08.159590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec17320-3a5f-4875-a6b1-ed4904046c43 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:08.159887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec17320-3a5f-4875-a6b1-ed4904046c43 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:08.160170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec17320-3a5f-4875-a6b1-ed4904046c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:08.257993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-bec17320-3a5f-4875-a6b1-ed4904046c43 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:08.267273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-bec17320-3a5f-4875-a6b1-ed4904046c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:08.288891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34286c1-89aa-4f5a-ae77-4b51ba5d2ff6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:08.290491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f34286c1-89aa-4f5a-ae77-4b51ba5d2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:08.310300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 934/1848] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:08.310868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34286c1-89aa-4f5a-ae77-4b51ba5d2ff6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:08.312965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec17320-3a5f-4875-a6b1-ed4904046c43 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:08.326274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:08.327389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:08.327728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:08.328026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] PATH_INFO: `/v3/projects/8986cd573b6044b0a35366520e0f9b4a` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:08.332943 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8986cd573b6044b0a35366520e0f9b4a)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:08.337742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec17320-3a5f-4875-a6b1-ed4904046c43 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:08.339250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:08.351605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46408a-d75b-4ad6-9d2a-5280270d1d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:08.352243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46408a-d75b-4ad6-9d2a-5280270d1d68 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:08.352522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46408a-d75b-4ad6-9d2a-5280270d1d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:08.352794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46408a-d75b-4ad6-9d2a-5280270d1d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:08.353795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46408a-d75b-4ad6-9d2a-5280270d1d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:08.354107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46408a-d75b-4ad6-9d2a-5280270d1d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:08.357647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46408a-d75b-4ad6-9d2a-5280270d1d68 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:08.412562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 935/1849] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:08.417952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46408a-d75b-4ad6-9d2a-5280270d1d68 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:08.441739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46408a-d75b-4ad6-9d2a-5280270d1d68 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:08.483188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:08.492366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8986cd573b6044b0a35366520e0f9b4a', 'request_id': 'req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:08.532390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8986cd573b6044b0a35366520e0f9b4a', 'request_id': 'req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:08.564844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8986cd573b6044b0a35366520e0f9b4a', 'request_id': 'req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:08.622313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] The token cache is being invalidate because project 8986cd573b6044b0a35366520e0f9b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:08.622833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:08.626380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:08.630973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 915/1850] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:08 2022] DELETE /identity/v3/projects/8986cd573b6044b0a35366520e0f9b4a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:08.636339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:08.640877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:08.665191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa634e-e50c-4c58-a040-0a085c5029d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:08.666717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa634e-e50c-4c58-a040-0a085c5029d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:08.667500 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa634e-e50c-4c58-a040-0a085c5029d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:08.668450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa634e-e50c-4c58-a040-0a085c5029d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:08.669994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa634e-e50c-4c58-a040-0a085c5029d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:08.672956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa634e-e50c-4c58-a040-0a085c5029d2 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:08.733802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 936/1851] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:08 2022] POST /identity/v3/projects => generated 371 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:08.738868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa634e-e50c-4c58-a040-0a085c5029d2 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:08.743297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5aaa634e-e50c-4c58-a040-0a085c5029d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:08.840810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4d3e1-ee3d-4e3c-a941-50f0d5ca5824 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:08.934275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa634e-e50c-4c58-a040-0a085c5029d2 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:08.939545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1644ed-f8cc-424e-afc8-d065c9d25830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:08.940374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1644ed-f8cc-424e-afc8-d065c9d25830 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:08.941179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1644ed-f8cc-424e-afc8-d065c9d25830 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:08.941696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1644ed-f8cc-424e-afc8-d065c9d25830 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:08.942467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1644ed-f8cc-424e-afc8-d065c9d25830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:08.946653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1644ed-f8cc-424e-afc8-d065c9d25830 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:08.985188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:08.985849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:08.986131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:08.986412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] PATH_INFO: `/v3/users/f734e7ce23c248a0a4dfb55fbea10b74` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:08.987713 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f734e7ce23c248a0a4dfb55fbea10b74)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:08.988331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 937/1852] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:08 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:08.989528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1644ed-f8cc-424e-afc8-d065c9d25830 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:08.989724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:09.003280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1644ed-f8cc-424e-afc8-d065c9d25830 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:09.009704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a72b6b-da63-44d1-b33a-0fae3195807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:09.014307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72b6b-da63-44d1-b33a-0fae3195807e admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:09.014610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72b6b-da63-44d1-b33a-0fae3195807e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:09.037460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72b6b-da63-44d1-b33a-0fae3195807e admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:09.041760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a72b6b-da63-44d1-b33a-0fae3195807e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:09.053827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a72b6b-da63-44d1-b33a-0fae3195807e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:09.062507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:09.115560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 938/1853] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:09.116617 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a72b6b-da63-44d1-b33a-0fae3195807e admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:09.124757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-31a72b6b-da63-44d1-b33a-0fae3195807e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:09.138851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f734e7ce23c248a0a4dfb55fbea10b74'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.190355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a72b6b-da63-44d1-b33a-0fae3195807e admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:09.191398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f734e7ce23c248a0a4dfb55fbea10b74'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.220273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:09.220941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f734e7ce23c248a0a4dfb55fbea10b74'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.222896 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:09.223889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:09.224515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] PATH_INFO: `/v3/projects/106c2b3709fe46c587943e3b6d85460a` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:09.231436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=106c2b3709fe46c587943e3b6d85460a)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:09.241544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:09.248970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f734e7ce23c248a0a4dfb55fbea10b74'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.254176 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f734e7ce23c248a0a4dfb55fbea10b74'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.257519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:09.268516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 916/1854] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:08 2022] DELETE /identity/v3/users/f734e7ce23c248a0a4dfb55fbea10b74 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:09.270068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:09.273486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:09.364770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106c2b3709fe46c587943e3b6d85460a', 'request_id': 'req-a6805f40-aed3-4616-9197-8c6bce8db72c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.376168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106c2b3709fe46c587943e3b6d85460a', 'request_id': 'req-a6805f40-aed3-4616-9197-8c6bce8db72c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.387567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106c2b3709fe46c587943e3b6d85460a', 'request_id': 'req-a6805f40-aed3-4616-9197-8c6bce8db72c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.423807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] The token cache is being invalidate because project 106c2b3709fe46c587943e3b6d85460a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:09.425009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.425812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:09.431218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 939/1855] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:09 2022] DELETE /identity/v3/projects/106c2b3709fe46c587943e3b6d85460a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:09.450233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b859b69-accb-4fcd-bd53-46651bc0779b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:09.451499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:09.454342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:09.541971 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261ee17-9ace-4fad-b029-deacdc00bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:09.542813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261ee17-9ace-4fad-b029-deacdc00bc6f admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:09.543176 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261ee17-9ace-4fad-b029-deacdc00bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:09.543526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261ee17-9ace-4fad-b029-deacdc00bc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:09.544298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261ee17-9ace-4fad-b029-deacdc00bc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:09.546196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261ee17-9ace-4fad-b029-deacdc00bc6f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:09.567949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 917/1856] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:09.574351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261ee17-9ace-4fad-b029-deacdc00bc6f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:09.576789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1261ee17-9ace-4fad-b029-deacdc00bc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:09.606057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261ee17-9ace-4fad-b029-deacdc00bc6f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:09.612921 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e19b6b-4fbb-46d1-8c51-e356e7b6094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:09.614022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e19b6b-4fbb-46d1-8c51-e356e7b6094f admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:09.614404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e19b6b-4fbb-46d1-8c51-e356e7b6094f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:09.614870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e19b6b-4fbb-46d1-8c51-e356e7b6094f admin admin] PATH_INFO: `/v3/projects/520b60238573499f9b94c64bfcf65184/users/68e1992870de447fa8382881d06c0f84/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:09.636670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e19b6b-4fbb-46d1-8c51-e356e7b6094f admin admin] RBAC: Authorizing `identity:create_grant(project_id=520b60238573499f9b94c64bfcf65184, user_id=68e1992870de447fa8382881d06c0f84, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:09.640828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e19b6b-4fbb-46d1-8c51-e356e7b6094f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:09.679197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 918/1857] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:09 2022] PUT /identity/v3/projects/520b60238573499f9b94c64bfcf65184/users/68e1992870de447fa8382881d06c0f84/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:09.683592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba786a-45f6-4b1c-8f1c-46907fd449b6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:09.684260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba786a-45f6-4b1c-8f1c-46907fd449b6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:09.684416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba786a-45f6-4b1c-8f1c-46907fd449b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:09.714003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805f40-aed3-4616-9197-8c6bce8db72c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:09.752567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-72ba786a-45f6-4b1c-8f1c-46907fd449b6 None None] MFA Rules not processed for user `68e1992870de447fa8382881d06c0f84`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:09.756449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-72ba786a-45f6-4b1c-8f1c-46907fd449b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:09.879422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:09.880290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:09.881111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:09.881397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] PATH_INFO: `/v3/users/688768d8b21d411f989490690209f83d` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:09.890059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] RBAC: Authorizing `identity:delete_user(user_id=688768d8b21d411f989490690209f83d)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:09.892811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:09.940833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 919/1858] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:09.944176 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba786a-45f6-4b1c-8f1c-46907fd449b6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:09.951472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:09.988931 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba786a-45f6-4b1c-8f1c-46907fd449b6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:09.998569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09426a52-6414-4a8b-84cc-40a4e93df1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:09.999234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09426a52-6414-4a8b-84cc-40a4e93df1de admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:09.999520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09426a52-6414-4a8b-84cc-40a4e93df1de admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:09.999796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09426a52-6414-4a8b-84cc-40a4e93df1de admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:10.000432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09426a52-6414-4a8b-84cc-40a4e93df1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:10.001974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688768d8b21d411f989490690209f83d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:10.002663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688768d8b21d411f989490690209f83d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:10.005499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09426a52-6414-4a8b-84cc-40a4e93df1de admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:10.024568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:10.041774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688768d8b21d411f989490690209f83d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:10.053775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688768d8b21d411f989490690209f83d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:10.054586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688768d8b21d411f989490690209f83d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:10.090385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 920/1859] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:09 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:10.095089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09426a52-6414-4a8b-84cc-40a4e93df1de admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:10.097635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 940/1860] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:09 2022] DELETE /identity/v3/users/688768d8b21d411f989490690209f83d => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:10.098553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-09426a52-6414-4a8b-84cc-40a4e93df1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:10.331084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09426a52-6414-4a8b-84cc-40a4e93df1de admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:10.491476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc214a23-45c3-4b40-ab7e-073ec45027c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:10.495352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc214a23-45c3-4b40-ab7e-073ec45027c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:10.496011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc214a23-45c3-4b40-ab7e-073ec45027c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:10.496425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc214a23-45c3-4b40-ab7e-073ec45027c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:10.497265 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc214a23-45c3-4b40-ab7e-073ec45027c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:10.500479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc214a23-45c3-4b40-ab7e-073ec45027c5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:10.541963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 921/1861] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:10 2022] POST /identity/v3/users => generated 293 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:10.547512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:10.569649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec341894-6687-42cc-b85f-bc61f854589b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:10.582782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865beba-8261-4b1f-8231-ed4e730269fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:10.583615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865beba-8261-4b1f-8231-ed4e730269fe admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:10.583996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865beba-8261-4b1f-8231-ed4e730269fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:10.584393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865beba-8261-4b1f-8231-ed4e730269fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:10.585210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865beba-8261-4b1f-8231-ed4e730269fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:10.587134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865beba-8261-4b1f-8231-ed4e730269fe admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:10.619207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 941/1862] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:10.621969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc214a23-45c3-4b40-ab7e-073ec45027c5 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:10.638743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc214a23-45c3-4b40-ab7e-073ec45027c5 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:10.656060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe1e22-65a7-4bd0-8fdb-75ceb0c9146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:10.659471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe1e22-65a7-4bd0-8fdb-75ceb0c9146e admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:10.659787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe1e22-65a7-4bd0-8fdb-75ceb0c9146e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:10.660111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe1e22-65a7-4bd0-8fdb-75ceb0c9146e admin admin] PATH_INFO: `/v3/projects/e459a60fced84c2aa9cc0410608c44c3/users/5afa81e46ab14fd8ae3275c0b29e06f6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:10.714086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe1e22-65a7-4bd0-8fdb-75ceb0c9146e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e459a60fced84c2aa9cc0410608c44c3, user_id=5afa81e46ab14fd8ae3275c0b29e06f6, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:10.717241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe1e22-65a7-4bd0-8fdb-75ceb0c9146e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:10.744504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 922/1863] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:10 2022] PUT /identity/v3/projects/e459a60fced84c2aa9cc0410608c44c3/users/5afa81e46ab14fd8ae3275c0b29e06f6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:10.750244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865beba-8261-4b1f-8231-ed4e730269fe admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:10.784304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe1e22-65a7-4bd0-8fdb-75ceb0c9146e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:10.786511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f4fe1e22-65a7-4bd0-8fdb-75ceb0c9146e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:10.797904 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865beba-8261-4b1f-8231-ed4e730269fe admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:10.941791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe1e22-65a7-4bd0-8fdb-75ceb0c9146e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:10.950215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:10.952996 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:10.954582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:10.954994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] PATH_INFO: `/v3/projects/52d42309a6b744d3ad023f25355deed6` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:10.957461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d42309a6b744d3ad023f25355deed6)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:10.964315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:10.967991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:10.976326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe587c-03ed-4c5a-958a-89724f8fc179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:10.977354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe587c-03ed-4c5a-958a-89724f8fc179 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:10.977736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe587c-03ed-4c5a-958a-89724f8fc179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:10.978106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe587c-03ed-4c5a-958a-89724f8fc179 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:10.978990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe587c-03ed-4c5a-958a-89724f8fc179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:10.980679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe587c-03ed-4c5a-958a-89724f8fc179 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:10.995158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 942/1864] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:10.999367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe587c-03ed-4c5a-958a-89724f8fc179 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.012630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe587c-03ed-4c5a-958a-89724f8fc179 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.020243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674fdf6-9830-4e37-8969-483e576bcd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.020243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674fdf6-9830-4e37-8969-483e576bcd1a admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.020712 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674fdf6-9830-4e37-8969-483e576bcd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.021209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674fdf6-9830-4e37-8969-483e576bcd1a admin admin] PATH_INFO: `/v3/projects/e459a60fced84c2aa9cc0410608c44c3/users/5afa81e46ab14fd8ae3275c0b29e06f6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.023844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674fdf6-9830-4e37-8969-483e576bcd1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e459a60fced84c2aa9cc0410608c44c3, user_id=5afa81e46ab14fd8ae3275c0b29e06f6, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.027513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674fdf6-9830-4e37-8969-483e576bcd1a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.051658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 943/1865] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:10 2022] PUT /identity/v3/projects/e459a60fced84c2aa9cc0410608c44c3/users/5afa81e46ab14fd8ae3275c0b29e06f6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:11.070175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9b555-84ff-4cf3-af38-78796ab4b9f7 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.075501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9b555-84ff-4cf3-af38-78796ab4b9f7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.076212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9b555-84ff-4cf3-af38-78796ab4b9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.109366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d42309a6b744d3ad023f25355deed6', 'request_id': 'req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:11.118192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d42309a6b744d3ad023f25355deed6', 'request_id': 'req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:11.130908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d42309a6b744d3ad023f25355deed6', 'request_id': 'req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:11.162890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-17f9b555-84ff-4cf3-af38-78796ab4b9f7 None None] MFA Rules not processed for user `5afa81e46ab14fd8ae3275c0b29e06f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:11.166397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-17f9b555-84ff-4cf3-af38-78796ab4b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:11.191866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] The token cache is being invalidate because project 52d42309a6b744d3ad023f25355deed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:11.192153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:11.194485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7ac0266b-eccc-4c72-a0d2-fd2550cdcc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:11.196705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 923/1866] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:10 2022] DELETE /identity/v3/projects/52d42309a6b744d3ad023f25355deed6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:11.203679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d59f-f9ae-4273-891f-ef592aa648ee None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.204032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d59f-f9ae-4273-891f-ef592aa648ee None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.204487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d59f-f9ae-4273-891f-ef592aa648ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.239426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6cd1d59f-f9ae-4273-891f-ef592aa648ee None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:11.240690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6cd1d59f-f9ae-4273-891f-ef592aa648ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:11.293062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 944/1867] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:11.309655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9b555-84ff-4cf3-af38-78796ab4b9f7 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.311812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-17f9b555-84ff-4cf3-af38-78796ab4b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:11.319837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:11.380305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 924/1868] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:11.389263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719c131-e637-4f8d-86b9-e6a07ec6204c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.389696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719c131-e637-4f8d-86b9-e6a07ec6204c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.390476 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719c131-e637-4f8d-86b9-e6a07ec6204c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.411106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9b555-84ff-4cf3-af38-78796ab4b9f7 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.417856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7585559-f9f3-47da-a981-5ac77096531d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.418914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7585559-f9f3-47da-a981-5ac77096531d service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.419385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7585559-f9f3-47da-a981-5ac77096531d service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.419761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7585559-f9f3-47da-a981-5ac77096531d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.435395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7585559-f9f3-47da-a981-5ac77096531d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.437963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7585559-f9f3-47da-a981-5ac77096531d service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.461899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1719c131-e637-4f8d-86b9-e6a07ec6204c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:11.467953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1719c131-e637-4f8d-86b9-e6a07ec6204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:11.475369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 945/1869] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:11.498535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7585559-f9f3-47da-a981-5ac77096531d service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.500548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 925/1870] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:11.519853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7585559-f9f3-47da-a981-5ac77096531d service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.526093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.526706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.527012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.527284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.527931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:11.528376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.530203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.546062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 946/1871] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:11.552575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719c131-e637-4f8d-86b9-e6a07ec6204c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.564932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719c131-e637-4f8d-86b9-e6a07ec6204c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.569797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4328-bbdd-4450-9a2e-198d3a6e224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.570427 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4328-bbdd-4450-9a2e-198d3a6e224c admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.570801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4328-bbdd-4450-9a2e-198d3a6e224c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.571244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4328-bbdd-4450-9a2e-198d3a6e224c admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.571892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c4328-bbdd-4450-9a2e-198d3a6e224c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.574896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c4328-bbdd-4450-9a2e-198d3a6e224c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.646007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.648563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:11.654976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 926/1872] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:11 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:11.656426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4328-bbdd-4450-9a2e-198d3a6e224c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.675343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eac227-ef93-42c5-8d11-7b5a4f0a3ccf admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.732395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.733307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.733307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.733564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.735596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:11.737414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4328-bbdd-4450-9a2e-198d3a6e224c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.743223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc694a0-73cb-42aa-ad7e-1dffb0a3d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.744053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc694a0-73cb-42aa-ad7e-1dffb0a3d6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.745077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc694a0-73cb-42aa-ad7e-1dffb0a3d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.745451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc694a0-73cb-42aa-ad7e-1dffb0a3d6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.746179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc694a0-73cb-42aa-ad7e-1dffb0a3d6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.748324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc694a0-73cb-42aa-ad7e-1dffb0a3d6f0 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.757568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:11.778064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 927/1873] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:11 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:11.784510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc694a0-73cb-42aa-ad7e-1dffb0a3d6f0 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.796599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc694a0-73cb-42aa-ad7e-1dffb0a3d6f0 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.803040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab40818-334f-4f5c-b9e3-128b9a35dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.803715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab40818-334f-4f5c-b9e3-128b9a35dbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.804110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab40818-334f-4f5c-b9e3-128b9a35dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.804422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab40818-334f-4f5c-b9e3-128b9a35dbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.805419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab40818-334f-4f5c-b9e3-128b9a35dbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.807468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab40818-334f-4f5c-b9e3-128b9a35dbb4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.819264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 928/1874] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:11.823316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab40818-334f-4f5c-b9e3-128b9a35dbb4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.824101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.825665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.835708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 947/1875] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:11.836698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.839508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:11.848938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab40818-334f-4f5c-b9e3-128b9a35dbb4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.855806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de585769-e583-4239-810e-7a969b419191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.856433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de585769-e583-4239-810e-7a969b419191 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.856712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de585769-e583-4239-810e-7a969b419191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.856991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de585769-e583-4239-810e-7a969b419191 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.857635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de585769-e583-4239-810e-7a969b419191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.859286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de585769-e583-4239-810e-7a969b419191 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.868823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83113f1e-2ecd-4a9e-851c-33e91b234b3a service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.870522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 929/1876] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:11.874799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de585769-e583-4239-810e-7a969b419191 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:11.878965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.878965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.878965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.878965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] PATH_INFO: `/v3/projects/95aeccb6fd7c4296b9207d4ed47f67d9` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.880514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=95aeccb6fd7c4296b9207d4ed47f67d9)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.882423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.885653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de585769-e583-4239-810e-7a969b419191 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:11.891205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3313966-fe2c-4aec-ad1c-4dc5f4524c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:11.892146 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313966-fe2c-4aec-ad1c-4dc5f4524c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.892146 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313966-fe2c-4aec-ad1c-4dc5f4524c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.892420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313966-fe2c-4aec-ad1c-4dc5f4524c75 admin admin] PATH_INFO: `/v3/projects/7b6bd307c6a841e89781127ec98640cd/users/7d7afdd5f26e4787981ab64c0b76546e/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.911762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3313966-fe2c-4aec-ad1c-4dc5f4524c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6bd307c6a841e89781127ec98640cd, user_id=7d7afdd5f26e4787981ab64c0b76546e, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:11.914477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3313966-fe2c-4aec-ad1c-4dc5f4524c75 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:11.933672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 930/1877] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:11 2022] PUT /identity/v3/projects/7b6bd307c6a841e89781127ec98640cd/users/7d7afdd5f26e4787981ab64c0b76546e/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:11.948026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:11.948280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80ab0-e962-4381-b909-6f2974fe5d70 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:11.948386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80ab0-e962-4381-b909-6f2974fe5d70 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:11.948640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80ab0-e962-4381-b909-6f2974fe5d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:11.960923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95aeccb6fd7c4296b9207d4ed47f67d9', 'request_id': 'req-8b0b4e2c-adee-44c0-b994-7252002449ae'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:11.972887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95aeccb6fd7c4296b9207d4ed47f67d9', 'request_id': 'req-8b0b4e2c-adee-44c0-b994-7252002449ae'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:11.984131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95aeccb6fd7c4296b9207d4ed47f67d9', 'request_id': 'req-8b0b4e2c-adee-44c0-b994-7252002449ae'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:11.985466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-45d80ab0-e962-4381-b909-6f2974fe5d70 None None] MFA Rules not processed for user `7d7afdd5f26e4787981ab64c0b76546e`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:11.986722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-45d80ab0-e962-4381-b909-6f2974fe5d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:11.997376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] The token cache is being invalidate because project 95aeccb6fd7c4296b9207d4ed47f67d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:11.997842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:11.998514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:12.000134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 948/1878] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:11 2022] DELETE /identity/v3/projects/95aeccb6fd7c4296b9207d4ed47f67d9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:12.003908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:12.005351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:12.081262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b4e2c-adee-44c0-b994-7252002449ae admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:12.082908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 931/1879] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:12.086792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:12.087433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:12.087617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d80ab0-e962-4381-b909-6f2974fe5d70 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:12.088312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:12.088535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] PATH_INFO: `/v3/users/838d13b92e104684a398f1db3f39abf3` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:12.089749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=838d13b92e104684a398f1db3f39abf3)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:12.090280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-45d80ab0-e962-4381-b909-6f2974fe5d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:12.091714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:12.105867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d80ab0-e962-4381-b909-6f2974fe5d70 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:12.111222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef2745-e6cc-4f8e-b3a4-64a1bd896aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:12.112011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef2745-e6cc-4f8e-b3a4-64a1bd896aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:12.112119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef2745-e6cc-4f8e-b3a4-64a1bd896aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:12.112353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef2745-e6cc-4f8e-b3a4-64a1bd896aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:12.112975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef2745-e6cc-4f8e-b3a4-64a1bd896aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:12.114959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef2745-e6cc-4f8e-b3a4-64a1bd896aa0 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:12.196613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 932/1880] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:12 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:12.202364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef2745-e6cc-4f8e-b3a4-64a1bd896aa0 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:12.215707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838d13b92e104684a398f1db3f39abf3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:12.216377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838d13b92e104684a398f1db3f39abf3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:12.229734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838d13b92e104684a398f1db3f39abf3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:12.238470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838d13b92e104684a398f1db3f39abf3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:12.239268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838d13b92e104684a398f1db3f39abf3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:12.254832 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 949/1881] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:12 2022] DELETE /identity/v3/users/838d13b92e104684a398f1db3f39abf3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:12.274726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef2745-e6cc-4f8e-b3a4-64a1bd896aa0 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:12.296711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:12.392574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956646-a3e3-4fce-ab29-98acbe3154dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:12.393205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956646-a3e3-4fce-ab29-98acbe3154dd admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:12.393587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956646-a3e3-4fce-ab29-98acbe3154dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:12.393868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956646-a3e3-4fce-ab29-98acbe3154dd admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:12.395383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b956646-a3e3-4fce-ab29-98acbe3154dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:12.398226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b956646-a3e3-4fce-ab29-98acbe3154dd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:12.449298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 933/1882] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:12 2022] POST /identity/v3/users => generated 301 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:12.452800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:12.454523 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:12.478241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce975-90a4-4e4e-884b-d19dfeaaaf94 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:12.488069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aba08b-8d2b-48f9-8878-2b8ed6d56916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:12.488710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aba08b-8d2b-48f9-8878-2b8ed6d56916 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:12.488994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aba08b-8d2b-48f9-8878-2b8ed6d56916 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:12.489268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aba08b-8d2b-48f9-8878-2b8ed6d56916 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:12.489926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aba08b-8d2b-48f9-8878-2b8ed6d56916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:12.491592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aba08b-8d2b-48f9-8878-2b8ed6d56916 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:12.512827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 950/1883] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:12.517051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956646-a3e3-4fce-ab29-98acbe3154dd admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:12.534289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956646-a3e3-4fce-ab29-98acbe3154dd admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:12.549498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda0ad-5a5f-405f-b619-ee392a935c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:12.550424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda0ad-5a5f-405f-b619-ee392a935c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:12.550837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda0ad-5a5f-405f-b619-ee392a935c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:12.551289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda0ad-5a5f-405f-b619-ee392a935c9b admin admin] PATH_INFO: `/v3/projects/595c8d0738cd4882a1b91973fb4503fd/users/110ef275065247fea2380495b2c91296/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:12.574671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdda0ad-5a5f-405f-b619-ee392a935c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=595c8d0738cd4882a1b91973fb4503fd, user_id=110ef275065247fea2380495b2c91296, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:12.577635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdda0ad-5a5f-405f-b619-ee392a935c9b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:12.625944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 934/1884] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:12 2022] PUT /identity/v3/projects/595c8d0738cd4882a1b91973fb4503fd/users/110ef275065247fea2380495b2c91296/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:12.633235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aba08b-8d2b-48f9-8878-2b8ed6d56916 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:12.647899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aba08b-8d2b-48f9-8878-2b8ed6d56916 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:12.726690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:12.797121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0401-2ed5-4c44-afa5-accee01ebdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:12.797890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0401-2ed5-4c44-afa5-accee01ebdab admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:12.798918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0401-2ed5-4c44-afa5-accee01ebdab admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:12.798918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0401-2ed5-4c44-afa5-accee01ebdab admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:12.800153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f0401-2ed5-4c44-afa5-accee01ebdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:12.801880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f0401-2ed5-4c44-afa5-accee01ebdab admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:12.814276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 951/1885] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:12.818742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda0ad-5a5f-405f-b619-ee392a935c9b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:12.832691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda0ad-5a5f-405f-b619-ee392a935c9b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:12.841442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b89b7b-3ae4-4dea-90f1-2bd3bc6f99b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:12.842333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b89b7b-3ae4-4dea-90f1-2bd3bc6f99b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:12.842753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b89b7b-3ae4-4dea-90f1-2bd3bc6f99b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:12.843216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b89b7b-3ae4-4dea-90f1-2bd3bc6f99b5 admin admin] PATH_INFO: `/v3/projects/595c8d0738cd4882a1b91973fb4503fd/users/110ef275065247fea2380495b2c91296/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:12.845440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b89b7b-3ae4-4dea-90f1-2bd3bc6f99b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595c8d0738cd4882a1b91973fb4503fd, user_id=110ef275065247fea2380495b2c91296, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:12.845942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0401-2ed5-4c44-afa5-accee01ebdab admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:12.849043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-407f0401-2ed5-4c44-afa5-accee01ebdab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:12.849192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b89b7b-3ae4-4dea-90f1-2bd3bc6f99b5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:12.873724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0401-2ed5-4c44-afa5-accee01ebdab admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:12.887983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 935/1886] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:12 2022] PUT /identity/v3/projects/595c8d0738cd4882a1b91973fb4503fd/users/110ef275065247fea2380495b2c91296/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:12.899410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e7605-2a71-48a4-be3c-dff3632d0401 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:12.899870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e7605-2a71-48a4-be3c-dff3632d0401 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:12.900954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e7605-2a71-48a4-be3c-dff3632d0401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:12.944789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0c8e7605-2a71-48a4-be3c-dff3632d0401 None None] MFA Rules not processed for user `110ef275065247fea2380495b2c91296`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:12.946556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0c8e7605-2a71-48a4-be3c-dff3632d0401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:12.949639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:12.950303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:12.950588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:12.950921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] PATH_INFO: `/v3/projects/6081e49567484f81984b764ac0987bbe` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:12.952142 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6081e49567484f81984b764ac0987bbe)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:12.956067 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.029901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6081e49567484f81984b764ac0987bbe', 'request_id': 'req-5e4983a8-82b8-42a1-8287-160300d280c3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.039189 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6081e49567484f81984b764ac0987bbe', 'request_id': 'req-5e4983a8-82b8-42a1-8287-160300d280c3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.047022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 936/1887] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:13.058804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e7605-2a71-48a4-be3c-dff3632d0401 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.059206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0c8e7605-2a71-48a4-be3c-dff3632d0401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:13.060796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6081e49567484f81984b764ac0987bbe', 'request_id': 'req-5e4983a8-82b8-42a1-8287-160300d280c3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.074810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] The token cache is being invalidate because project 6081e49567484f81984b764ac0987bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:13.075131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.076225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5e4983a8-82b8-42a1-8287-160300d280c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.077898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 952/1888] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:12 2022] DELETE /identity/v3/projects/6081e49567484f81984b764ac0987bbe => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:13.084845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898080f9-edee-49c2-96ed-4128ec4fde7c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.086940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898080f9-edee-49c2-96ed-4128ec4fde7c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.086940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898080f9-edee-49c2-96ed-4128ec4fde7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.109441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-898080f9-edee-49c2-96ed-4128ec4fde7c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:13.111039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-898080f9-edee-49c2-96ed-4128ec4fde7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:13.146048 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e7605-2a71-48a4-be3c-dff3632d0401 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.160894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:13.185355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 953/1889] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:13.194023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410773-08c8-4a49-9fe4-dc51971375ea None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.194433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410773-08c8-4a49-9fe4-dc51971375ea None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.194605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410773-08c8-4a49-9fe4-dc51971375ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.216715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:13.218969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883f82e-2ddc-43e3-8ffe-c763babc3977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.219653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883f82e-2ddc-43e3-8ffe-c763babc3977 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.219936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883f82e-2ddc-43e3-8ffe-c763babc3977 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.220281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883f82e-2ddc-43e3-8ffe-c763babc3977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.222732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8883f82e-2ddc-43e3-8ffe-c763babc3977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:13.225665 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-54410773-08c8-4a49-9fe4-dc51971375ea None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:13.228068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-54410773-08c8-4a49-9fe4-dc51971375ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:13.244895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 954/1890] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:13.246194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54410773-08c8-4a49-9fe4-dc51971375ea None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.259160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54410773-08c8-4a49-9fe4-dc51971375ea None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.266472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77681215-21bb-4973-94a7-02770915fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.267126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77681215-21bb-4973-94a7-02770915fd15 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.267393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77681215-21bb-4973-94a7-02770915fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.267644 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77681215-21bb-4973-94a7-02770915fd15 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.268294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77681215-21bb-4973-94a7-02770915fd15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:13.268601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77681215-21bb-4973-94a7-02770915fd15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.270220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77681215-21bb-4973-94a7-02770915fd15 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.286760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 955/1891] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:13.288523 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77681215-21bb-4973-94a7-02770915fd15 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.301241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77681215-21bb-4973-94a7-02770915fd15 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.308445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184b4be-8afb-41c3-8ff1-a008a1a310f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.309143 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184b4be-8afb-41c3-8ff1-a008a1a310f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.309476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184b4be-8afb-41c3-8ff1-a008a1a310f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.309778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184b4be-8afb-41c3-8ff1-a008a1a310f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.310417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184b4be-8afb-41c3-8ff1-a008a1a310f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.312573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184b4be-8afb-41c3-8ff1-a008a1a310f7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.313144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883f82e-2ddc-43e3-8ffe-c763babc3977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.314671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883f82e-2ddc-43e3-8ffe-c763babc3977 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.337501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 937/1892] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:13.381043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 956/1893] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:13 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:13.392582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883f82e-2ddc-43e3-8ffe-c763babc3977 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.405892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883f82e-2ddc-43e3-8ffe-c763babc3977 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.488205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c2fbc-cc4f-4621-8af6-e30d961d9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.489121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c2fbc-cc4f-4621-8af6-e30d961d9e97 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.489407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c2fbc-cc4f-4621-8af6-e30d961d9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.489685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c2fbc-cc4f-4621-8af6-e30d961d9e97 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.491498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c2fbc-cc4f-4621-8af6-e30d961d9e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.495013 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c2fbc-cc4f-4621-8af6-e30d961d9e97 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.513005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184b4be-8afb-41c3-8ff1-a008a1a310f7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.515285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3184b4be-8afb-41c3-8ff1-a008a1a310f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:13.522793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 938/1894] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:13 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:13.531958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c2fbc-cc4f-4621-8af6-e30d961d9e97 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.532358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184b4be-8afb-41c3-8ff1-a008a1a310f7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.544722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.545397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.545616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c2fbc-cc4f-4621-8af6-e30d961d9e97 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.545718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.545958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] PATH_INFO: `/v3/users/7d7afdd5f26e4787981ab64c0b76546e` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.549564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7afdd5f26e4787981ab64c0b76546e)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.550359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ee73c-ad23-4321-b781-7a1182853879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.550999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ee73c-ad23-4321-b781-7a1182853879 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.551273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ee73c-ad23-4321-b781-7a1182853879 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.551683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.551809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ee73c-ad23-4321-b781-7a1182853879 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.552313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ee73c-ad23-4321-b781-7a1182853879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.553948 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ee73c-ad23-4321-b781-7a1182853879 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.573226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 939/1895] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:13.577637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ee73c-ad23-4321-b781-7a1182853879 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.590175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ee73c-ad23-4321-b781-7a1182853879 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.602258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c88eb-ecce-4848-a88b-96311c3140d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.604571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c88eb-ecce-4848-a88b-96311c3140d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.605031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c88eb-ecce-4848-a88b-96311c3140d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.605477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c88eb-ecce-4848-a88b-96311c3140d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.606345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c88eb-ecce-4848-a88b-96311c3140d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.608349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c88eb-ecce-4848-a88b-96311c3140d7 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.626542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 940/1896] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:13.630919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c88eb-ecce-4848-a88b-96311c3140d7 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.642834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7afdd5f26e4787981ab64c0b76546e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.643614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7afdd5f26e4787981ab64c0b76546e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.653555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c88eb-ecce-4848-a88b-96311c3140d7 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.657623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7afdd5f26e4787981ab64c0b76546e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.660369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22fa73-47ee-4d1d-b832-725aa2ca5b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.661217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22fa73-47ee-4d1d-b832-725aa2ca5b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.661767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22fa73-47ee-4d1d-b832-725aa2ca5b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.662057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22fa73-47ee-4d1d-b832-725aa2ca5b60 admin admin] PATH_INFO: `/v3/projects/1c6b6d5868694299a94c487dbc27ceb1/users/784b1debaa934e188cdd247a32f2264b/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.666953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7afdd5f26e4787981ab64c0b76546e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.667751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c5b1ced8-1385-40f8-9291-4a8005f44e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7afdd5f26e4787981ab64c0b76546e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:13.679026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22fa73-47ee-4d1d-b832-725aa2ca5b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6b6d5868694299a94c487dbc27ceb1, user_id=784b1debaa934e188cdd247a32f2264b, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.682371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 957/1897] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:13 2022] DELETE /identity/v3/users/7d7afdd5f26e4787981ab64c0b76546e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:13.682938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22fa73-47ee-4d1d-b832-725aa2ca5b60 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.687036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608cbcb-1fe0-4716-bb7f-a641cf091bae None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.687324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608cbcb-1fe0-4716-bb7f-a641cf091bae None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.687603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608cbcb-1fe0-4716-bb7f-a641cf091bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.700863 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 941/1898] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:13 2022] PUT /identity/v3/projects/1c6b6d5868694299a94c487dbc27ceb1/users/784b1debaa934e188cdd247a32f2264b/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:13.712092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1608cbcb-1fe0-4716-bb7f-a641cf091bae None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:13.713642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1608cbcb-1fe0-4716-bb7f-a641cf091bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:13.714750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c84f7-c76f-45fc-954e-457cbcb149e7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.715080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c84f7-c76f-45fc-954e-457cbcb149e7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.715356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c84f7-c76f-45fc-954e-457cbcb149e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.733756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:13.751005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-768c84f7-c76f-45fc-954e-457cbcb149e7 None None] MFA Rules not processed for user `784b1debaa934e188cdd247a32f2264b`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:13.752299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-768c84f7-c76f-45fc-954e-457cbcb149e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:13.784183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 958/1899] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:13.810351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608cbcb-1fe0-4716-bb7f-a641cf091bae None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.811786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1608cbcb-1fe0-4716-bb7f-a641cf091bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:13.839985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 942/1900] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:13.846343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c84f7-c76f-45fc-954e-457cbcb149e7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.848683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-768c84f7-c76f-45fc-954e-457cbcb149e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:13.861269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:13.872180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c84f7-c76f-45fc-954e-457cbcb149e7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.879391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ce31-36fc-4ca1-b0e5-0277d53dd7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.880084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ce31-36fc-4ca1-b0e5-0277d53dd7ba admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.880229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608cbcb-1fe0-4716-bb7f-a641cf091bae None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:13.881886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ce31-36fc-4ca1-b0e5-0277d53dd7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.882163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ce31-36fc-4ca1-b0e5-0277d53dd7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.882882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ce31-36fc-4ca1-b0e5-0277d53dd7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.886391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ce31-36fc-4ca1-b0e5-0277d53dd7ba admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.887822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c7bcf-29b3-4514-b10e-43f94e7cbabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:13.888700 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c7bcf-29b3-4514-b10e-43f94e7cbabc service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:13.889614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c7bcf-29b3-4514-b10e-43f94e7cbabc service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:13.890265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c7bcf-29b3-4514-b10e-43f94e7cbabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:13.905697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c7bcf-29b3-4514-b10e-43f94e7cbabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:13.907266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c7bcf-29b3-4514-b10e-43f94e7cbabc service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:13.923626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 959/1901] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:13.925099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 943/1902] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:13 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:13.929599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c7bcf-29b3-4514-b10e-43f94e7cbabc service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:13.941685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c7bcf-29b3-4514-b10e-43f94e7cbabc service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:14.028151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f0137-6738-43d6-a6e5-82df4ccb62e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:14.028786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0137-6738-43d6-a6e5-82df4ccb62e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.029105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0137-6738-43d6-a6e5-82df4ccb62e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.029380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0137-6738-43d6-a6e5-82df4ccb62e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.030071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f0137-6738-43d6-a6e5-82df4ccb62e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:14.032331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f0137-6738-43d6-a6e5-82df4ccb62e3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:14.062856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 960/1903] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:13 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:14.066359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ce31-36fc-4ca1-b0e5-0277d53dd7ba admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:14.082804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ce31-36fc-4ca1-b0e5-0277d53dd7ba admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:14.088033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833441ae-d4db-4d53-ba5b-ce5d020c2753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:14.088671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833441ae-d4db-4d53-ba5b-ce5d020c2753 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.089205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833441ae-d4db-4d53-ba5b-ce5d020c2753 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.089483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833441ae-d4db-4d53-ba5b-ce5d020c2753 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.090371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833441ae-d4db-4d53-ba5b-ce5d020c2753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:14.093191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833441ae-d4db-4d53-ba5b-ce5d020c2753 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:14.113522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 944/1904] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:14.117170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f0137-6738-43d6-a6e5-82df4ccb62e3 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:14.137397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f0137-6738-43d6-a6e5-82df4ccb62e3 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:14.163043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249633e9-618a-4707-9d20-62a9fdb321c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:14.163734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249633e9-618a-4707-9d20-62a9fdb321c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.164009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249633e9-618a-4707-9d20-62a9fdb321c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.164277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249633e9-618a-4707-9d20-62a9fdb321c5 admin admin] PATH_INFO: `/v3/projects/376669887af242f8b0d287c5168c03de/users/839a0168460d4b458b6665b3a1a53274/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.184195 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249633e9-618a-4707-9d20-62a9fdb321c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376669887af242f8b0d287c5168c03de, user_id=839a0168460d4b458b6665b3a1a53274, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:14.187864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249633e9-618a-4707-9d20-62a9fdb321c5 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:14.209105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 961/1905] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:14 2022] PUT /identity/v3/projects/376669887af242f8b0d287c5168c03de/users/839a0168460d4b458b6665b3a1a53274/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:14.210208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833441ae-d4db-4d53-ba5b-ce5d020c2753 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:14.232035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833441ae-d4db-4d53-ba5b-ce5d020c2753 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:14.347342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e45c2-f576-4295-b068-48c75fa92661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:14.349074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e45c2-f576-4295-b068-48c75fa92661 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.349398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e45c2-f576-4295-b068-48c75fa92661 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.349680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e45c2-f576-4295-b068-48c75fa92661 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.350540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e45c2-f576-4295-b068-48c75fa92661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:14.352268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e45c2-f576-4295-b068-48c75fa92661 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:14.374753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 945/1906] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:14.378364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249633e9-618a-4707-9d20-62a9fdb321c5 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:14.393346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249633e9-618a-4707-9d20-62a9fdb321c5 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:14.398379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bae03b-3226-4031-8ec3-d006f9da8a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:14.399421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae03b-3226-4031-8ec3-d006f9da8a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.399658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae03b-3226-4031-8ec3-d006f9da8a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.400047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae03b-3226-4031-8ec3-d006f9da8a47 admin admin] PATH_INFO: `/v3/projects/376669887af242f8b0d287c5168c03de/users/839a0168460d4b458b6665b3a1a53274/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.403017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bae03b-3226-4031-8ec3-d006f9da8a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376669887af242f8b0d287c5168c03de, user_id=839a0168460d4b458b6665b3a1a53274, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:14.405772 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bae03b-3226-4031-8ec3-d006f9da8a47 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:14.430541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 962/1907] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:14 2022] PUT /identity/v3/projects/376669887af242f8b0d287c5168c03de/users/839a0168460d4b458b6665b3a1a53274/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:14.441006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e45c2-f576-4295-b068-48c75fa92661 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:14.443052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b41e45c2-f576-4295-b068-48c75fa92661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:14.445936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfa3f3-0941-4a99-8702-417075ac1526 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.446300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfa3f3-0941-4a99-8702-417075ac1526 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.446640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfa3f3-0941-4a99-8702-417075ac1526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.468274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e45c2-f576-4295-b068-48c75fa92661 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:14.490305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d0cfa3f3-0941-4a99-8702-417075ac1526 None None] MFA Rules not processed for user `839a0168460d4b458b6665b3a1a53274`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:14.491683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d0cfa3f3-0941-4a99-8702-417075ac1526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:14.537537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:14.538177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.538455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.538728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] PATH_INFO: `/v3/projects/7b6bd307c6a841e89781127ec98640cd` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.539876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6bd307c6a841e89781127ec98640cd)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:14.541832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:14.543404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:14.576734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 963/1908] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:14.576734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfa3f3-0941-4a99-8702-417075ac1526 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:14.576734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d0cfa3f3-0941-4a99-8702-417075ac1526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:14.589839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfa3f3-0941-4a99-8702-417075ac1526 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:14.604428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6bd307c6a841e89781127ec98640cd', 'request_id': 'req-1f450817-b8ae-4cc9-9217-561c82613955'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.605786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:14.612848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6bd307c6a841e89781127ec98640cd', 'request_id': 'req-1f450817-b8ae-4cc9-9217-561c82613955'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.622205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6bd307c6a841e89781127ec98640cd', 'request_id': 'req-1f450817-b8ae-4cc9-9217-561c82613955'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.635049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] The token cache is being invalidate because project 7b6bd307c6a841e89781127ec98640cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:14.635528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.636454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.638345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 946/1909] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:14 2022] DELETE /identity/v3/projects/7b6bd307c6a841e89781127ec98640cd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:14.643237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:14.644288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:14.680732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:14.682154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.682504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.682905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] PATH_INFO: `/v3/users/08596361d0284822aa89afa02a41b325` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.684351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] RBAC: Authorizing `identity:delete_user(user_id=08596361d0284822aa89afa02a41b325)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:14.686375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:14.740773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450817-b8ae-4cc9-9217-561c82613955 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:14.745989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda4f72-f518-4d43-b3c6-78c110f6a24c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:14.746666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4f72-f518-4d43-b3c6-78c110f6a24c service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.746980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4f72-f518-4d43-b3c6-78c110f6a24c service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.747598 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4f72-f518-4d43-b3c6-78c110f6a24c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.749077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ecda4f72-f518-4d43-b3c6-78c110f6a24c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:14.758346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08596361d0284822aa89afa02a41b325'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.760099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08596361d0284822aa89afa02a41b325'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.776387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08596361d0284822aa89afa02a41b325'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.786919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08596361d0284822aa89afa02a41b325'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.787581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08596361d0284822aa89afa02a41b325'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:14.804433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 964/1910] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:14 2022] DELETE /identity/v3/users/08596361d0284822aa89afa02a41b325 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:14.804433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:14.804433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:14.827129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda4f72-f518-4d43-b3c6-78c110f6a24c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:14.829717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda4f72-f518-4d43-b3c6-78c110f6a24c service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:14.854056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 947/1911] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:14.857942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1d9ef-beb3-491d-bd46-1c22a95a2736 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.858654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1d9ef-beb3-491d-bd46-1c22a95a2736 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.859152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1d9ef-beb3-491d-bd46-1c22a95a2736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.942747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d5b1d9ef-beb3-491d-bd46-1c22a95a2736 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:14.944112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d5b1d9ef-beb3-491d-bd46-1c22a95a2736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:14.947743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf0504-e3cc-4939-b250-b88553c4132f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:14.954577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:14.954577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:14.954993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:14.955272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] PATH_INFO: `/v3/users/110ef275065247fea2380495b2c91296` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:14.956786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=110ef275065247fea2380495b2c91296)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:14.958814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:14.961292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 948/1912] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:14.974430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1d9ef-beb3-491d-bd46-1c22a95a2736 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:14.976025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d5b1d9ef-beb3-491d-bd46-1c22a95a2736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:15.034209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:15.051005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:15.071503 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110ef275065247fea2380495b2c91296'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:15.072589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110ef275065247fea2380495b2c91296'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:15.076254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1d9ef-beb3-491d-bd46-1c22a95a2736 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:15.105970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dbc00-70b0-49c9-9f27-7a57799f3247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:15.107449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110ef275065247fea2380495b2c91296'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:15.108891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dbc00-70b0-49c9-9f27-7a57799f3247 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:15.109185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dbc00-70b0-49c9-9f27-7a57799f3247 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:15.111025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dbc00-70b0-49c9-9f27-7a57799f3247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:15.126348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110ef275065247fea2380495b2c91296'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:15.127893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110ef275065247fea2380495b2c91296'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:15.139725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dbc00-70b0-49c9-9f27-7a57799f3247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:15.143255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dbc00-70b0-49c9-9f27-7a57799f3247 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:15.166670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 949/1913] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:15.174258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 965/1914] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:14 2022] DELETE /identity/v3/users/110ef275065247fea2380495b2c91296 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:15.905298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dbc00-70b0-49c9-9f27-7a57799f3247 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:15.915347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:15.918511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:15.927076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dbc00-70b0-49c9-9f27-7a57799f3247 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:16.026123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8156-8b60-48a2-baf7-ba1a9f5103cd admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:16.026664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:16.027383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:16.027669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:16.027941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] PATH_INFO: `/v3/projects/595c8d0738cd4882a1b91973fb4503fd` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:16.029167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=595c8d0738cd4882a1b91973fb4503fd)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:16.031378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:16.031881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:16.032202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:16.032557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:16.032900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] PATH_INFO: `/v3/projects/8654ca6e6e984434aebb5f921ab94dc4` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:16.034253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8654ca6e6e984434aebb5f921ab94dc4)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:16.036616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:16.104959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8654ca6e6e984434aebb5f921ab94dc4', 'request_id': 'req-edcb8148-861f-436e-a652-5b343cb56df9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.108061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595c8d0738cd4882a1b91973fb4503fd', 'request_id': 'req-14ac1e82-2078-438f-b408-7655b9b9cab5'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.111444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8654ca6e6e984434aebb5f921ab94dc4', 'request_id': 'req-edcb8148-861f-436e-a652-5b343cb56df9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.118375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595c8d0738cd4882a1b91973fb4503fd', 'request_id': 'req-14ac1e82-2078-438f-b408-7655b9b9cab5'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.120873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8654ca6e6e984434aebb5f921ab94dc4', 'request_id': 'req-edcb8148-861f-436e-a652-5b343cb56df9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.129024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595c8d0738cd4882a1b91973fb4503fd', 'request_id': 'req-14ac1e82-2078-438f-b408-7655b9b9cab5'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.140047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] The token cache is being invalidate because project 8654ca6e6e984434aebb5f921ab94dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:16.140366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.141058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.143217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 966/1915] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:15 2022] DELETE /identity/v3/projects/8654ca6e6e984434aebb5f921ab94dc4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:16.146793 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:16.148393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:16.158069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] The token cache is being invalidate because project 595c8d0738cd4882a1b91973fb4503fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:16.158273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.161054 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-14ac1e82-2078-438f-b408-7655b9b9cab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.163014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 950/1916] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:15 2022] DELETE /identity/v3/projects/595c8d0738cd4882a1b91973fb4503fd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:16.168720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b738ebe-cc43-4a81-8c63-15d11d00f98a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:16.169120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b738ebe-cc43-4a81-8c63-15d11d00f98a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:16.169470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b738ebe-cc43-4a81-8c63-15d11d00f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:16.198289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4b738ebe-cc43-4a81-8c63-15d11d00f98a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:16.199718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4b738ebe-cc43-4a81-8c63-15d11d00f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:16.235253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:16.256787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb8148-861f-436e-a652-5b343cb56df9 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:16.311945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 951/1917] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:16.332935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecc187-3c4e-4529-a5aa-1bf215adec8a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:16.333539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecc187-3c4e-4529-a5aa-1bf215adec8a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:16.334378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecc187-3c4e-4529-a5aa-1bf215adec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:16.364113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:16.367322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:16.367322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:16.367322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] PATH_INFO: `/v3/users/327797c02b5b48279a7956ddfaaad844` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:16.367322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327797c02b5b48279a7956ddfaaad844)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:16.370421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:16.394300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5eecc187-3c4e-4529-a5aa-1bf215adec8a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:16.395861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5eecc187-3c4e-4529-a5aa-1bf215adec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:16.406191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 952/1918] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:16.411945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecc187-3c4e-4529-a5aa-1bf215adec8a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:16.421677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:16.426282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecc187-3c4e-4529-a5aa-1bf215adec8a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:16.434089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14cdba-3019-46ca-a645-a166a1abf75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:16.435124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14cdba-3019-46ca-a645-a166a1abf75c admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:16.435841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14cdba-3019-46ca-a645-a166a1abf75c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:16.436190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14cdba-3019-46ca-a645-a166a1abf75c admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:16.437614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14cdba-3019-46ca-a645-a166a1abf75c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:16.438352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14cdba-3019-46ca-a645-a166a1abf75c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:16.441930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14cdba-3019-46ca-a645-a166a1abf75c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:16.474857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 953/1919] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:16.475870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14cdba-3019-46ca-a645-a166a1abf75c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:16.483089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327797c02b5b48279a7956ddfaaad844'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.483967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327797c02b5b48279a7956ddfaaad844'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.490169 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14cdba-3019-46ca-a645-a166a1abf75c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:16.497178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f96b8-0bbb-4477-a6ff-3074a4b106c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:16.498156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f96b8-0bbb-4477-a6ff-3074a4b106c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:16.498621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f96b8-0bbb-4477-a6ff-3074a4b106c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:16.499309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f96b8-0bbb-4477-a6ff-3074a4b106c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:16.500371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f96b8-0bbb-4477-a6ff-3074a4b106c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:16.503155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327797c02b5b48279a7956ddfaaad844'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.503448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f96b8-0bbb-4477-a6ff-3074a4b106c7 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:16.516231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327797c02b5b48279a7956ddfaaad844'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.517295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327797c02b5b48279a7956ddfaaad844'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:16.544241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 967/1920] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:16 2022] DELETE /identity/v3/users/327797c02b5b48279a7956ddfaaad844 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:16.559014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 954/1921] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:16 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:16.561419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:16.564258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:16.814109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f86b55-b9a1-4f10-b42e-33cbdb0e6d34 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:16.848300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:16.933567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7298a-60ca-418d-a219-ed7aee76b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:16.935501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7298a-60ca-418d-a219-ed7aee76b2ff admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:16.936009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7298a-60ca-418d-a219-ed7aee76b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:16.936374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7298a-60ca-418d-a219-ed7aee76b2ff admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:16.937105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7298a-60ca-418d-a219-ed7aee76b2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:16.943935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7298a-60ca-418d-a219-ed7aee76b2ff admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.005255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f96b8-0bbb-4477-a6ff-3074a4b106c7 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.013618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 968/1922] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:16 2022] POST /identity/v3/users => generated 284 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:17.027583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f96b8-0bbb-4477-a6ff-3074a4b106c7 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.033171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849885b-0f04-45e2-97a1-989e16e7474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.034229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849885b-0f04-45e2-97a1-989e16e7474e admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.034720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849885b-0f04-45e2-97a1-989e16e7474e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.035285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849885b-0f04-45e2-97a1-989e16e7474e admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.036205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849885b-0f04-45e2-97a1-989e16e7474e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.038939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849885b-0f04-45e2-97a1-989e16e7474e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.053900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 955/1923] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:17.058500 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7298a-60ca-418d-a219-ed7aee76b2ff admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.079080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7298a-60ca-418d-a219-ed7aee76b2ff admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.092744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee623a36-61e0-4aab-9fc3-00b62a2cb63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.093378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee623a36-61e0-4aab-9fc3-00b62a2cb63f admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.093657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee623a36-61e0-4aab-9fc3-00b62a2cb63f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.093931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee623a36-61e0-4aab-9fc3-00b62a2cb63f admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.094580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee623a36-61e0-4aab-9fc3-00b62a2cb63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.096270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee623a36-61e0-4aab-9fc3-00b62a2cb63f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.122058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 969/1924] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:17.126345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849885b-0f04-45e2-97a1-989e16e7474e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.139245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849885b-0f04-45e2-97a1-989e16e7474e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.148153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fe528-b1a0-455b-8dd8-48fc8fd69782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.152222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fe528-b1a0-455b-8dd8-48fc8fd69782 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.152517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fe528-b1a0-455b-8dd8-48fc8fd69782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.152797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fe528-b1a0-455b-8dd8-48fc8fd69782 admin admin] PATH_INFO: `/v3/projects/fc6963b41c1a4bbe8fc43d8cb8120070/users/af920d3803d446fdb2cd4fcc5bff0062/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.173641 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fe528-b1a0-455b-8dd8-48fc8fd69782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6963b41c1a4bbe8fc43d8cb8120070, user_id=af920d3803d446fdb2cd4fcc5bff0062, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.174796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fe528-b1a0-455b-8dd8-48fc8fd69782 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.211549 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 956/1925] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:17 2022] PUT /identity/v3/projects/fc6963b41c1a4bbe8fc43d8cb8120070/users/af920d3803d446fdb2cd4fcc5bff0062/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:17.222516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ea85-9208-4c81-85d5-29c0abd579e7 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.222861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ea85-9208-4c81-85d5-29c0abd579e7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.223145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ea85-9208-4c81-85d5-29c0abd579e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.253343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fe528-b1a0-455b-8dd8-48fc8fd69782 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.255560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4f7fe528-b1a0-455b-8dd8-48fc8fd69782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:17.305390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a7f4ea85-9208-4c81-85d5-29c0abd579e7 None None] MFA Rules not processed for user `af920d3803d446fdb2cd4fcc5bff0062`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:17.306986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a7f4ea85-9208-4c81-85d5-29c0abd579e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:17.358623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fe528-b1a0-455b-8dd8-48fc8fd69782 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.370281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.371154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.371435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.371734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] PATH_INFO: `/v3/projects/2e278873591c4f1ab876ccf10fde4a1c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.372984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e278873591c4f1ab876ccf10fde4a1c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.375270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.398190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 970/1926] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:17.399540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ea85-9208-4c81-85d5-29c0abd579e7 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.414629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ea85-9208-4c81-85d5-29c0abd579e7 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.421222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1ed52-aace-40e9-92f5-4abd8f4fe784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.421960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1ed52-aace-40e9-92f5-4abd8f4fe784 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.422315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1ed52-aace-40e9-92f5-4abd8f4fe784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.422592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1ed52-aace-40e9-92f5-4abd8f4fe784 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.424626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1ed52-aace-40e9-92f5-4abd8f4fe784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.426430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1ed52-aace-40e9-92f5-4abd8f4fe784 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.450317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e278873591c4f1ab876ccf10fde4a1c', 'request_id': 'req-d99ba6f5-4d55-4d90-965c-ad687d1b9744'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:17.469434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 971/1927] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:17 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:17.470790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e278873591c4f1ab876ccf10fde4a1c', 'request_id': 'req-d99ba6f5-4d55-4d90-965c-ad687d1b9744'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:17.473589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1ed52-aace-40e9-92f5-4abd8f4fe784 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.512709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e278873591c4f1ab876ccf10fde4a1c', 'request_id': 'req-d99ba6f5-4d55-4d90-965c-ad687d1b9744'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:17.542233 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] The token cache is being invalidate because project 2e278873591c4f1ab876ccf10fde4a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:17.542578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:17.543821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d99ba6f5-4d55-4d90-965c-ad687d1b9744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:17.548616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 957/1928] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:17 2022] DELETE /identity/v3/projects/2e278873591c4f1ab876ccf10fde4a1c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:17.553727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a989-19ce-4e69-9d87-6f80c46de6cf None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.554039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a989-19ce-4e69-9d87-6f80c46de6cf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.554257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a989-19ce-4e69-9d87-6f80c46de6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.591109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d5f1a989-19ce-4e69-9d87-6f80c46de6cf None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:17.594028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d5f1a989-19ce-4e69-9d87-6f80c46de6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:17.608801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 958/1929] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:17.611636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1ed52-aace-40e9-92f5-4abd8f4fe784 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.616253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5d7d-30d8-429f-8646-88500a3b101e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.616877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5d7d-30d8-429f-8646-88500a3b101e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.617276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5d7d-30d8-429f-8646-88500a3b101e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.618823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293f89e-256b-4de4-87a9-e5ed69c15e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.620049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293f89e-256b-4de4-87a9-e5ed69c15e3a admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.620717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293f89e-256b-4de4-87a9-e5ed69c15e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.620971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293f89e-256b-4de4-87a9-e5ed69c15e3a admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.622559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293f89e-256b-4de4-87a9-e5ed69c15e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.625490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293f89e-256b-4de4-87a9-e5ed69c15e3a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.648739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:17.659359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-440e5d7d-30d8-429f-8646-88500a3b101e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:17.660870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-440e5d7d-30d8-429f-8646-88500a3b101e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:17.670577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 959/1930] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:17.674532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e5d7d-30d8-429f-8646-88500a3b101e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.679017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 972/1931] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:17 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:17.682718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293f89e-256b-4de4-87a9-e5ed69c15e3a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.684946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b293f89e-256b-4de4-87a9-e5ed69c15e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:17.686118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e5d7d-30d8-429f-8646-88500a3b101e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.691281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca23fb4-251a-4969-8fbc-777134093324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.691998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca23fb4-251a-4969-8fbc-777134093324 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.692438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca23fb4-251a-4969-8fbc-777134093324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.692784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca23fb4-251a-4969-8fbc-777134093324 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.693567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca23fb4-251a-4969-8fbc-777134093324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:17.694226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca23fb4-251a-4969-8fbc-777134093324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.695759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca23fb4-251a-4969-8fbc-777134093324 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.699419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293f89e-256b-4de4-87a9-e5ed69c15e3a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.704259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:17.706894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d7abb-34aa-464d-aa98-5c3d68e0cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.707802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d7abb-34aa-464d-aa98-5c3d68e0cc86 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.708224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d7abb-34aa-464d-aa98-5c3d68e0cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.708757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d7abb-34aa-464d-aa98-5c3d68e0cc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.709473 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d7abb-34aa-464d-aa98-5c3d68e0cc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.711758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 960/1932] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:48:17.717695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d7abb-34aa-464d-aa98-5c3d68e0cc86 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.719047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca23fb4-251a-4969-8fbc-777134093324 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.729403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 973/1933] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:17.733928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d7abb-34aa-464d-aa98-5c3d68e0cc86 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.736268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca23fb4-251a-4969-8fbc-777134093324 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.742113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e4698-e038-4206-8e1a-302019232eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.742871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e4698-e038-4206-8e1a-302019232eff admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.743247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e4698-e038-4206-8e1a-302019232eff admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.743684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e4698-e038-4206-8e1a-302019232eff admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.744413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e4698-e038-4206-8e1a-302019232eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.746669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e4698-e038-4206-8e1a-302019232eff admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.752411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d7abb-34aa-464d-aa98-5c3d68e0cc86 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.767230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26c665-02e7-4fa3-a34a-c23de0d5b12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.768073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26c665-02e7-4fa3-a34a-c23de0d5b12a admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.768417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26c665-02e7-4fa3-a34a-c23de0d5b12a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.768798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26c665-02e7-4fa3-a34a-c23de0d5b12a admin admin] PATH_INFO: `/v3/projects/4e1cb081c8b54f36a6bbf59c084f1ced/users/23f07bdcfe9f4c4aa5892a7eb92ab8fb/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.785501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 961/1934] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:17 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:17.797486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e4698-e038-4206-8e1a-302019232eff admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.800173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26c665-02e7-4fa3-a34a-c23de0d5b12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1cb081c8b54f36a6bbf59c084f1ced, user_id=23f07bdcfe9f4c4aa5892a7eb92ab8fb, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.805191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26c665-02e7-4fa3-a34a-c23de0d5b12a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.838272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 974/1935] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:17 2022] PUT /identity/v3/projects/4e1cb081c8b54f36a6bbf59c084f1ced/users/23f07bdcfe9f4c4aa5892a7eb92ab8fb/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:17.838272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26c665-02e7-4fa3-a34a-c23de0d5b12a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.890668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e4698-e038-4206-8e1a-302019232eff admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.913341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26c665-02e7-4fa3-a34a-c23de0d5b12a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.919705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d265c-cb32-4b2f-9b3f-ee0868bede37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.920379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d265c-cb32-4b2f-9b3f-ee0868bede37 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.920719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d265c-cb32-4b2f-9b3f-ee0868bede37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.920928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d265c-cb32-4b2f-9b3f-ee0868bede37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.921582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d265c-cb32-4b2f-9b3f-ee0868bede37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.923321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d265c-cb32-4b2f-9b3f-ee0868bede37 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.944262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 975/1936] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:17.946128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d265c-cb32-4b2f-9b3f-ee0868bede37 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:17.960629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d265c-cb32-4b2f-9b3f-ee0868bede37 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:17.968513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3ce57-49e2-4ecf-9605-8ccdc22fcf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:17.969423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3ce57-49e2-4ecf-9605-8ccdc22fcf54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:17.969642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3ce57-49e2-4ecf-9605-8ccdc22fcf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:17.969946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3ce57-49e2-4ecf-9605-8ccdc22fcf54 admin admin] PATH_INFO: `/v3/projects/4e1cb081c8b54f36a6bbf59c084f1ced/users/23f07bdcfe9f4c4aa5892a7eb92ab8fb/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:17.972482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3ce57-49e2-4ecf-9605-8ccdc22fcf54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1cb081c8b54f36a6bbf59c084f1ced, user_id=23f07bdcfe9f4c4aa5892a7eb92ab8fb, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:17.985034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3ce57-49e2-4ecf-9605-8ccdc22fcf54 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:17.999835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275039c-9687-48a6-a68f-a09a5dc56f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:18.000574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275039c-9687-48a6-a68f-a09a5dc56f52 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.000846 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275039c-9687-48a6-a68f-a09a5dc56f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.001180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275039c-9687-48a6-a68f-a09a5dc56f52 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.001832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275039c-9687-48a6-a68f-a09a5dc56f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:18.004282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275039c-9687-48a6-a68f-a09a5dc56f52 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:18.029917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 976/1937] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:17 2022] PUT /identity/v3/projects/4e1cb081c8b54f36a6bbf59c084f1ced/users/23f07bdcfe9f4c4aa5892a7eb92ab8fb/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:18.033986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 962/1938] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:17 2022] POST /identity/v3/users => generated 282 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:18.037573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3ce57-49e2-4ecf-9605-8ccdc22fcf54 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:18.040259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea1a86-c89a-4e9c-b174-2456ac6fafb4 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.042586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea1a86-c89a-4e9c-b174-2456ac6fafb4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.043135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea1a86-c89a-4e9c-b174-2456ac6fafb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.086260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b6ea1a86-c89a-4e9c-b174-2456ac6fafb4 None None] MFA Rules not processed for user `23f07bdcfe9f4c4aa5892a7eb92ab8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:18.090910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b6ea1a86-c89a-4e9c-b174-2456ac6fafb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:18.136426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3ce57-49e2-4ecf-9605-8ccdc22fcf54 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:18.153684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68650f-2de5-44c7-b056-2c58ed6a75c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:18.154304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68650f-2de5-44c7-b056-2c58ed6a75c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.154585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68650f-2de5-44c7-b056-2c58ed6a75c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.154979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68650f-2de5-44c7-b056-2c58ed6a75c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.155622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68650f-2de5-44c7-b056-2c58ed6a75c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:18.157134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68650f-2de5-44c7-b056-2c58ed6a75c3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:18.183711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 977/1939] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:18.185043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773a09-3d11-4a98-81fd-ea88a87aac94 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.185329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773a09-3d11-4a98-81fd-ea88a87aac94 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.191590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:18.192030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773a09-3d11-4a98-81fd-ea88a87aac94 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.194840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 978/1940] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:48:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:48:18.195643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37773a09-3d11-4a98-81fd-ea88a87aac94 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:18.202412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 963/1941] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:18.216190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea1a86-c89a-4e9c-b174-2456ac6fafb4 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:18.217680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b6ea1a86-c89a-4e9c-b174-2456ac6fafb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:18.226683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37773a09-3d11-4a98-81fd-ea88a87aac94 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:18.240132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ac24f-372c-4126-b9b3-343c192d2ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:18.240726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac24f-372c-4126-b9b3-343c192d2ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.241004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac24f-372c-4126-b9b3-343c192d2ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.241278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac24f-372c-4126-b9b3-343c192d2ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.243576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ac24f-372c-4126-b9b3-343c192d2ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:18.248969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ac24f-372c-4126-b9b3-343c192d2ca7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:18.283431 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 979/1942] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:18.284890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5169245-e1e3-4518-a109-7ca8bf32fee3 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.285178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5169245-e1e3-4518-a109-7ca8bf32fee3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.285446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5169245-e1e3-4518-a109-7ca8bf32fee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.332929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e5169245-e1e3-4518-a109-7ca8bf32fee3 None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:18.333848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e5169245-e1e3-4518-a109-7ca8bf32fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:18.345942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea1a86-c89a-4e9c-b174-2456ac6fafb4 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:18.359760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290818fc-16c1-4398-8b0e-750e3de4a40a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:18.362115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290818fc-16c1-4398-8b0e-750e3de4a40a service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.362115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290818fc-16c1-4398-8b0e-750e3de4a40a service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.363779 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290818fc-16c1-4398-8b0e-750e3de4a40a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.394385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:18.409347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290818fc-16c1-4398-8b0e-750e3de4a40a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:18.414506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290818fc-16c1-4398-8b0e-750e3de4a40a service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:18.435832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 964/1943] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:18.449582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290818fc-16c1-4398-8b0e-750e3de4a40a service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:18.474009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290818fc-16c1-4398-8b0e-750e3de4a40a service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:18.478585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 980/1944] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:48:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:18.484984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c15ef-4b27-4d27-8896-77b95c57fde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:18.485420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c15ef-4b27-4d27-8896-77b95c57fde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.485706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c15ef-4b27-4d27-8896-77b95c57fde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.486051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c15ef-4b27-4d27-8896-77b95c57fde6 admin admin] PATH_INFO: `/v3/projects/a47f701ec3ae485a83e8b37211f3bae4/users/3deb7770b9904bafbcf3fc615329dcb6/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.507995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5169245-e1e3-4518-a109-7ca8bf32fee3 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:18.510558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e5169245-e1e3-4518-a109-7ca8bf32fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:18.525670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c15ef-4b27-4d27-8896-77b95c57fde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47f701ec3ae485a83e8b37211f3bae4, user_id=3deb7770b9904bafbcf3fc615329dcb6, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:18.528654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c15ef-4b27-4d27-8896-77b95c57fde6 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:18.539698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5169245-e1e3-4518-a109-7ca8bf32fee3 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:18.555245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 965/1945] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:18 2022] PUT /identity/v3/projects/a47f701ec3ae485a83e8b37211f3bae4/users/3deb7770b9904bafbcf3fc615329dcb6/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:18.557910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633016ef-a21b-4b63-a9c9-39f3820e74c9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.557910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633016ef-a21b-4b63-a9c9-39f3820e74c9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.557910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633016ef-a21b-4b63-a9c9-39f3820e74c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.594443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-633016ef-a21b-4b63-a9c9-39f3820e74c9 None None] MFA Rules not processed for user `3deb7770b9904bafbcf3fc615329dcb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:18.596541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-633016ef-a21b-4b63-a9c9-39f3820e74c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:18.626155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b668f-7785-4687-b499-3b452c38b651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:18.626882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b668f-7785-4687-b499-3b452c38b651 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.627223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b668f-7785-4687-b499-3b452c38b651 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.627844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b668f-7785-4687-b499-3b452c38b651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.639934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b668f-7785-4687-b499-3b452c38b651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:18.642598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b668f-7785-4687-b499-3b452c38b651 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:18.681240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 981/1946] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:18.682178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b668f-7785-4687-b499-3b452c38b651 service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:18.709665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 966/1947] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:18.721777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633016ef-a21b-4b63-a9c9-39f3820e74c9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:18.780754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b668f-7785-4687-b499-3b452c38b651 service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:18.784984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd9150-a45f-49ff-b31b-6196eb0543ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:18.785604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd9150-a45f-49ff-b31b-6196eb0543ca service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.785883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd9150-a45f-49ff-b31b-6196eb0543ca service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.786265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd9150-a45f-49ff-b31b-6196eb0543ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.789944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-82fd9150-a45f-49ff-b31b-6196eb0543ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:18.844910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633016ef-a21b-4b63-a9c9-39f3820e74c9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:18.850859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3be7a-2efb-4909-a8c1-da80af5d23c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:18.851711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3be7a-2efb-4909-a8c1-da80af5d23c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:18.852096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3be7a-2efb-4909-a8c1-da80af5d23c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:18.853443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3be7a-2efb-4909-a8c1-da80af5d23c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:18.855023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3be7a-2efb-4909-a8c1-da80af5d23c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:18.872808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3be7a-2efb-4909-a8c1-da80af5d23c1 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:18.893764 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:18.929499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 967/1948] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:18 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:18.938911 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3be7a-2efb-4909-a8c1-da80af5d23c1 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:18.981785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd9150-a45f-49ff-b31b-6196eb0543ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:18.984060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd9150-a45f-49ff-b31b-6196eb0543ca service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:18.991478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:19.001977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 982/1949] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:19.078930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3be7a-2efb-4909-a8c1-da80af5d23c1 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:19.085896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358b33-0c53-4ff0-8161-a29005eb0f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:19.086570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358b33-0c53-4ff0-8161-a29005eb0f5e admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:19.086824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358b33-0c53-4ff0-8161-a29005eb0f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:19.087109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358b33-0c53-4ff0-8161-a29005eb0f5e admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:19.099386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358b33-0c53-4ff0-8161-a29005eb0f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:19.105903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358b33-0c53-4ff0-8161-a29005eb0f5e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:19.169756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 968/1950] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:18 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:19.172391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd9150-a45f-49ff-b31b-6196eb0543ca service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:19.188196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd9150-a45f-49ff-b31b-6196eb0543ca service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:19.204628 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ba1c0-e3fe-47ab-ac53-d315ed639236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:19.205844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ba1c0-e3fe-47ab-ac53-d315ed639236 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:19.208002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ba1c0-e3fe-47ab-ac53-d315ed639236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:19.208589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ba1c0-e3fe-47ab-ac53-d315ed639236 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:19.210006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ba1c0-e3fe-47ab-ac53-d315ed639236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:19.217149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ba1c0-e3fe-47ab-ac53-d315ed639236 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:19.239336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 983/1951] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:19.246913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358b33-0c53-4ff0-8161-a29005eb0f5e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:19.268118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358b33-0c53-4ff0-8161-a29005eb0f5e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:19.284745 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c235e-6f29-4d9b-9041-faa84503e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:19.286469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c235e-6f29-4d9b-9041-faa84503e94c admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:19.286469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c235e-6f29-4d9b-9041-faa84503e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:19.286469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c235e-6f29-4d9b-9041-faa84503e94c admin admin] PATH_INFO: `/v3/projects/85a4e797a8ff486ab7b326ffa0452928/users/c2fb68764c6b4388bfe4d398a6627b26/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:19.330926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c235e-6f29-4d9b-9041-faa84503e94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a4e797a8ff486ab7b326ffa0452928, user_id=c2fb68764c6b4388bfe4d398a6627b26, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:19.335225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c235e-6f29-4d9b-9041-faa84503e94c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:19.367597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 969/1952] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:19 2022] PUT /identity/v3/projects/85a4e797a8ff486ab7b326ffa0452928/users/c2fb68764c6b4388bfe4d398a6627b26/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:19.372732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ba1c0-e3fe-47ab-ac53-d315ed639236 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:19.388027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ba1c0-e3fe-47ab-ac53-d315ed639236 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:19.561186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa52fe2-06e2-4484-afd9-d7e7b5a94a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:19.561186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa52fe2-06e2-4484-afd9-d7e7b5a94a91 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:19.561186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa52fe2-06e2-4484-afd9-d7e7b5a94a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:19.561186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa52fe2-06e2-4484-afd9-d7e7b5a94a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:19.561470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa52fe2-06e2-4484-afd9-d7e7b5a94a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:19.565260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa52fe2-06e2-4484-afd9-d7e7b5a94a91 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:19.593084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 984/1953] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:19.597345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c235e-6f29-4d9b-9041-faa84503e94c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:19.611717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c235e-6f29-4d9b-9041-faa84503e94c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:19.623828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2cf15-ccb5-4c35-af8d-c559a6436db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:19.627313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2cf15-ccb5-4c35-af8d-c559a6436db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:19.627634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2cf15-ccb5-4c35-af8d-c559a6436db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:19.627917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2cf15-ccb5-4c35-af8d-c559a6436db2 admin admin] PATH_INFO: `/v3/projects/85a4e797a8ff486ab7b326ffa0452928/users/c2fb68764c6b4388bfe4d398a6627b26/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:19.630057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2cf15-ccb5-4c35-af8d-c559a6436db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a4e797a8ff486ab7b326ffa0452928, user_id=c2fb68764c6b4388bfe4d398a6627b26, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:19.637344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2cf15-ccb5-4c35-af8d-c559a6436db2 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:19.676383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4749-dc6c-441e-bbda-b31c2270356b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:19.676680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4749-dc6c-441e-bbda-b31c2270356b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:19.676945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4749-dc6c-441e-bbda-b31c2270356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:19.679672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 970/1954] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:19 2022] PUT /identity/v3/projects/85a4e797a8ff486ab7b326ffa0452928/users/c2fb68764c6b4388bfe4d398a6627b26/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:19.754700 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-62bb4749-dc6c-441e-bbda-b31c2270356b None None] MFA Rules not processed for user `c2fb68764c6b4388bfe4d398a6627b26`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:19.758976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-62bb4749-dc6c-441e-bbda-b31c2270356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:19.894931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 985/1955] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:19.899143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2cf15-ccb5-4c35-af8d-c559a6436db2 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:19.901637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0ad2cf15-ccb5-4c35-af8d-c559a6436db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:19.964186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2cf15-ccb5-4c35-af8d-c559a6436db2 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:19.967737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27e02-3c38-4a3e-a5ff-d91f5075e814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:19.968345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27e02-3c38-4a3e-a5ff-d91f5075e814 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:19.968628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27e02-3c38-4a3e-a5ff-d91f5075e814 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:19.968899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27e02-3c38-4a3e-a5ff-d91f5075e814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:19.980259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27e02-3c38-4a3e-a5ff-d91f5075e814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:19.981867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27e02-3c38-4a3e-a5ff-d91f5075e814 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:19.992829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 971/1956] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:20.081513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4749-dc6c-441e-bbda-b31c2270356b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:20.092403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4749-dc6c-441e-bbda-b31c2270356b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:20.096175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d997c-00fe-4414-9cfa-57ed9b369523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:20.096788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d997c-00fe-4414-9cfa-57ed9b369523 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:20.097069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d997c-00fe-4414-9cfa-57ed9b369523 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:20.097341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d997c-00fe-4414-9cfa-57ed9b369523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:20.169810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d997c-00fe-4414-9cfa-57ed9b369523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:20.171937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d997c-00fe-4414-9cfa-57ed9b369523 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:20.182439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 986/1957] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:20.295309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27e02-3c38-4a3e-a5ff-d91f5075e814 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:20.305666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27e02-3c38-4a3e-a5ff-d91f5075e814 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:20.312478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c9b01-ce2d-4883-859f-38715d0ab415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:20.313105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c9b01-ce2d-4883-859f-38715d0ab415 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:20.313383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c9b01-ce2d-4883-859f-38715d0ab415 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:20.313644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c9b01-ce2d-4883-859f-38715d0ab415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:20.315503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2a9c9b01-ce2d-4883-859f-38715d0ab415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:20.374293 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:20.403458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c9b01-ce2d-4883-859f-38715d0ab415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:20.404976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c9b01-ce2d-4883-859f-38715d0ab415 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:20.415205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 972/1958] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:23.327035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d997c-00fe-4414-9cfa-57ed9b369523 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:23.341494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:23.454833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d997c-00fe-4414-9cfa-57ed9b369523 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:23.462924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:23.463769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:23.464053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:23.464774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] PATH_INFO: `/v3/users/3deb7770b9904bafbcf3fc615329dcb6` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:23.465924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3deb7770b9904bafbcf3fc615329dcb6)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:23.468427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:23.577285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3deb7770b9904bafbcf3fc615329dcb6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:23.579174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3deb7770b9904bafbcf3fc615329dcb6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:23.625405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3deb7770b9904bafbcf3fc615329dcb6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:23.635542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3deb7770b9904bafbcf3fc615329dcb6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:23.636248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3deb7770b9904bafbcf3fc615329dcb6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:23.659754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 987/1959] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:23 2022] DELETE /identity/v3/users/3deb7770b9904bafbcf3fc615329dcb6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:23.664600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76efc-12ef-40a0-8f7d-0876d51334af None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:23.665523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76efc-12ef-40a0-8f7d-0876d51334af None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:23.665859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76efc-12ef-40a0-8f7d-0876d51334af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:23.691502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-13c76efc-12ef-40a0-8f7d-0876d51334af None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:23.692968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-13c76efc-12ef-40a0-8f7d-0876d51334af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:23.795356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 973/1960] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:23.812049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:23.814923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:23.933466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cb8b3-8064-45fd-97f8-4fa27a574d44 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:23.947279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59db525-1b31-47e0-a88d-18a90c5f7ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:23.948163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59db525-1b31-47e0-a88d-18a90c5f7ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:23.948163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59db525-1b31-47e0-a88d-18a90c5f7ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:23.950162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59db525-1b31-47e0-a88d-18a90c5f7ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:23.967092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59db525-1b31-47e0-a88d-18a90c5f7ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:23.969278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59db525-1b31-47e0-a88d-18a90c5f7ad9 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:23.981883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 988/1961] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:24.336322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76efc-12ef-40a0-8f7d-0876d51334af None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:24.337833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-13c76efc-12ef-40a0-8f7d-0876d51334af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:24.357768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76efc-12ef-40a0-8f7d-0876d51334af None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:24.369316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:24.370417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:24.371105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:24.382379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] PATH_INFO: `/v3/projects/a47f701ec3ae485a83e8b37211f3bae4` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:24.388122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47f701ec3ae485a83e8b37211f3bae4)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:24.397803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:24.501718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47f701ec3ae485a83e8b37211f3bae4', 'request_id': 'req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.508136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47f701ec3ae485a83e8b37211f3bae4', 'request_id': 'req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.517369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47f701ec3ae485a83e8b37211f3bae4', 'request_id': 'req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.528322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] The token cache is being invalidate because project a47f701ec3ae485a83e8b37211f3bae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:24.528616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.529240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.530820 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 974/1962] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:24 2022] DELETE /identity/v3/projects/a47f701ec3ae485a83e8b37211f3bae4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:24.535248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59db525-1b31-47e0-a88d-18a90c5f7ad9 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:24.545233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59db525-1b31-47e0-a88d-18a90c5f7ad9 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:24.582078 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:24.627998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:24.628823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:24.629189 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:24.629492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] PATH_INFO: `/v3/users/c2fb68764c6b4388bfe4d398a6627b26` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:24.630877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fb68764c6b4388bfe4d398a6627b26)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:24.632958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:24.712316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fb68764c6b4388bfe4d398a6627b26'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.713147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fb68764c6b4388bfe4d398a6627b26'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.735518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fb68764c6b4388bfe4d398a6627b26'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.750713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fb68764c6b4388bfe4d398a6627b26'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.751846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fb68764c6b4388bfe4d398a6627b26'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:24.772319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 989/1963] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:24 2022] DELETE /identity/v3/users/c2fb68764c6b4388bfe4d398a6627b26 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:25.174131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:25.176179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:25.191600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff2a4-9127-4dd0-bfa3-48cddb83acdf admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:25.280388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:25.281114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:25.281491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:25.281688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] PATH_INFO: `/v3/users/af920d3803d446fdb2cd4fcc5bff0062` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:25.282924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af920d3803d446fdb2cd4fcc5bff0062)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:25.284888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:25.305802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:25.412489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af920d3803d446fdb2cd4fcc5bff0062'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.456526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af920d3803d446fdb2cd4fcc5bff0062'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.474496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:25.474655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af920d3803d446fdb2cd4fcc5bff0062'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.476941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:25.496329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef122035-a3cc-454c-897d-e8d744d9a4fb admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:25.511124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af920d3803d446fdb2cd4fcc5bff0062'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.512460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-327858ca-fa7a-4613-8043-a90cf86c5834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af920d3803d446fdb2cd4fcc5bff0062'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.521549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:25.524455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:25.525155 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:25.525675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] PATH_INFO: `/v3/projects/85a4e797a8ff486ab7b326ffa0452928` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:25.528222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a4e797a8ff486ab7b326ffa0452928)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:25.531228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:25.532500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 975/1964] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:25 2022] DELETE /identity/v3/users/af920d3803d446fdb2cd4fcc5bff0062 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:25.537510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1abb9-a3d6-4446-a196-4bba81861bd0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:25.537800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1abb9-a3d6-4446-a196-4bba81861bd0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:25.538184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1abb9-a3d6-4446-a196-4bba81861bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:25.601650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f2e1abb9-a3d6-4446-a196-4bba81861bd0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:25.603078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f2e1abb9-a3d6-4446-a196-4bba81861bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:25.619668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a4e797a8ff486ab7b326ffa0452928', 'request_id': 'req-3289b2f0-4d95-48b9-88f3-96f5b75b7304'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.628065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a4e797a8ff486ab7b326ffa0452928', 'request_id': 'req-3289b2f0-4d95-48b9-88f3-96f5b75b7304'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.645015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a4e797a8ff486ab7b326ffa0452928', 'request_id': 'req-3289b2f0-4d95-48b9-88f3-96f5b75b7304'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.674022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] The token cache is being invalidate because project 85a4e797a8ff486ab7b326ffa0452928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:25.676850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.678539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3289b2f0-4d95-48b9-88f3-96f5b75b7304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.683524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 990/1965] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:25 2022] DELETE /identity/v3/projects/85a4e797a8ff486ab7b326ffa0452928 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:25.690356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecc23f-35af-45ff-8e99-3d3c4ff086db None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:25.691338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecc23f-35af-45ff-8e99-3d3c4ff086db None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:25.697183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecc23f-35af-45ff-8e99-3d3c4ff086db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:25.757343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 976/1966] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:25.758054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-10ecc23f-35af-45ff-8e99-3d3c4ff086db None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:25.760482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-10ecc23f-35af-45ff-8e99-3d3c4ff086db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:25.772847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1abb9-a3d6-4446-a196-4bba81861bd0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:25.776518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f2e1abb9-a3d6-4446-a196-4bba81861bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:25.782112 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 991/1967] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:25.789654 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc07c-1c86-42d9-ac8a-4f875face065 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:25.790983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc07c-1c86-42d9-ac8a-4f875face065 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:25.791456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc07c-1c86-42d9-ac8a-4f875face065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:25.828908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-272bc07c-1c86-42d9-ac8a-4f875face065 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:25.832215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-272bc07c-1c86-42d9-ac8a-4f875face065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:25.848570 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 992/1968] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:25.858496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bc07c-1c86-42d9-ac8a-4f875face065 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:25.861767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-272bc07c-1c86-42d9-ac8a-4f875face065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:25.880155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1abb9-a3d6-4446-a196-4bba81861bd0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:25.883429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bc07c-1c86-42d9-ac8a-4f875face065 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:25.885257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d47bb6-5723-42ce-aacc-2926d829f09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:25.886105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d47bb6-5723-42ce-aacc-2926d829f09a service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:25.886446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d47bb6-5723-42ce-aacc-2926d829f09a service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:25.886725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d47bb6-5723-42ce-aacc-2926d829f09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:25.889555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:25.890271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:25.890794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:25.891129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] PATH_INFO: `/v3/users/784b1debaa934e188cdd247a32f2264b` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:25.892325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=784b1debaa934e188cdd247a32f2264b)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:25.894577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:25.897918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d47bb6-5723-42ce-aacc-2926d829f09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:25.899522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d47bb6-5723-42ce-aacc-2926d829f09a service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:25.914223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:25.916738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 977/1969] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:25.917562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d47bb6-5723-42ce-aacc-2926d829f09a service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:25.958673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d47bb6-5723-42ce-aacc-2926d829f09a service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:25.977481 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:25.978418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:25.979012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:25.979197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784b1debaa934e188cdd247a32f2264b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.979436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:25.979968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784b1debaa934e188cdd247a32f2264b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:25.981654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:25.982059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:25.983757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:25.996576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784b1debaa934e188cdd247a32f2264b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:26.007586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784b1debaa934e188cdd247a32f2264b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:26.008285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5c94381b-19f4-4c22-9528-abfebe8a6cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784b1debaa934e188cdd247a32f2264b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:26.014463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 978/1970] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:26.018405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:26.020877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:26.031134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 993/1971] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:25 2022] DELETE /identity/v3/users/784b1debaa934e188cdd247a32f2264b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:26.033332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f0960-4514-451d-9d74-20951b40e7d0 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:26.033597 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f0960-4514-451d-9d74-20951b40e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:26.034024 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f0960-4514-451d-9d74-20951b40e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:26.041044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1f6c-4233-4198-bbfd-39a831c88bcc admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:26.058129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-695f0960-4514-451d-9d74-20951b40e7d0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:26.059507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:26.059650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-695f0960-4514-451d-9d74-20951b40e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:26.152152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60279e5c-f32f-4915-bd77-346173e66188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:26.153673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60279e5c-f32f-4915-bd77-346173e66188 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:26.156228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60279e5c-f32f-4915-bd77-346173e66188 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:26.156740 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60279e5c-f32f-4915-bd77-346173e66188 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:26.160841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60279e5c-f32f-4915-bd77-346173e66188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:26.167674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60279e5c-f32f-4915-bd77-346173e66188 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:26.227326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 994/1972] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:26.240475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f0960-4514-451d-9d74-20951b40e7d0 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:26.243124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-695f0960-4514-451d-9d74-20951b40e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:26.263327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 979/1973] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:26 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:26.268695 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60279e5c-f32f-4915-bd77-346173e66188 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:26.347150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f0960-4514-451d-9d74-20951b40e7d0 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:26.412516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60279e5c-f32f-4915-bd77-346173e66188 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:26.416597 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:26.430147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc6af-2784-4ae8-8ba8-0bd1f70957fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:26.432793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc6af-2784-4ae8-8ba8-0bd1f70957fc admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:26.433177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc6af-2784-4ae8-8ba8-0bd1f70957fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:26.433362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc75b4-5a66-4afd-bd19-8c8698be6231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:26.433663 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc6af-2784-4ae8-8ba8-0bd1f70957fc admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:26.435145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdc6af-2784-4ae8-8ba8-0bd1f70957fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:26.436653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc75b4-5a66-4afd-bd19-8c8698be6231 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:26.436954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc75b4-5a66-4afd-bd19-8c8698be6231 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:26.437232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc75b4-5a66-4afd-bd19-8c8698be6231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:26.437547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdc6af-2784-4ae8-8ba8-0bd1f70957fc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:26.467276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc75b4-5a66-4afd-bd19-8c8698be6231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:26.469246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc75b4-5a66-4afd-bd19-8c8698be6231 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:26.491131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 980/1974] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:26 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:26.495141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 995/1975] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:26.496706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc6af-2784-4ae8-8ba8-0bd1f70957fc admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:26.511289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc6af-2784-4ae8-8ba8-0bd1f70957fc admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:26.517745 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabbd61-ec3c-4e98-9168-aacc158192b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:26.518376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabbd61-ec3c-4e98-9168-aacc158192b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:26.518661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabbd61-ec3c-4e98-9168-aacc158192b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:26.518999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabbd61-ec3c-4e98-9168-aacc158192b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:26.519660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabbd61-ec3c-4e98-9168-aacc158192b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:26.522218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabbd61-ec3c-4e98-9168-aacc158192b8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:26.539004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 981/1976] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:26.543048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc75b4-5a66-4afd-bd19-8c8698be6231 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:26.553906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc75b4-5a66-4afd-bd19-8c8698be6231 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:26.573259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabbd61-ec3c-4e98-9168-aacc158192b8 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:26.574125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1d75-66d7-43a7-be35-005f274c6d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:26.575512 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3cabbd61-ec3c-4e98-9168-aacc158192b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:26.575783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1d75-66d7-43a7-be35-005f274c6d10 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:26.576352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1d75-66d7-43a7-be35-005f274c6d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:26.576889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1d75-66d7-43a7-be35-005f274c6d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:26.577823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd1d75-66d7-43a7-be35-005f274c6d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:26.580253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd1d75-66d7-43a7-be35-005f274c6d10 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:26.598831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabbd61-ec3c-4e98-9168-aacc158192b8 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:26.606431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:26.607530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:26.608127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:26.623276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] PATH_INFO: `/v3/projects/fc6963b41c1a4bbe8fc43d8cb8120070` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:26.623276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6963b41c1a4bbe8fc43d8cb8120070)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:26.623719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:26.644285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 996/1977] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:26.650176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1d75-66d7-43a7-be35-005f274c6d10 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:26.688042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1d75-66d7-43a7-be35-005f274c6d10 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:26.699159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79dd74-7de6-4e3b-b86d-6a94bc5a6c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:26.700805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79dd74-7de6-4e3b-b86d-6a94bc5a6c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:26.701229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79dd74-7de6-4e3b-b86d-6a94bc5a6c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:26.701568 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79dd74-7de6-4e3b-b86d-6a94bc5a6c98 admin admin] PATH_INFO: `/v3/projects/d532b638881c4a2e8cdc2514bd24a07d/users/5b40e10c987d45c48b2dc308d174476d/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:26.736664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79dd74-7de6-4e3b-b86d-6a94bc5a6c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d532b638881c4a2e8cdc2514bd24a07d, user_id=5b40e10c987d45c48b2dc308d174476d, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:26.739536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79dd74-7de6-4e3b-b86d-6a94bc5a6c98 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:26.755218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6963b41c1a4bbe8fc43d8cb8120070', 'request_id': 'req-638afec8-850a-49ea-9cc0-63633a47ecd4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:26.768582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 997/1978] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:26 2022] PUT /identity/v3/projects/d532b638881c4a2e8cdc2514bd24a07d/users/5b40e10c987d45c48b2dc308d174476d/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:26.769719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6963b41c1a4bbe8fc43d8cb8120070', 'request_id': 'req-638afec8-850a-49ea-9cc0-63633a47ecd4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:26.779288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4df98-7b6e-4bb6-90db-8668dd29b8f5 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:26.779697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4df98-7b6e-4bb6-90db-8668dd29b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:26.780944 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4df98-7b6e-4bb6-90db-8668dd29b8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:26.788757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6963b41c1a4bbe8fc43d8cb8120070', 'request_id': 'req-638afec8-850a-49ea-9cc0-63633a47ecd4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:26.809640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:26.823904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] The token cache is being invalidate because project fc6963b41c1a4bbe8fc43d8cb8120070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:26.824223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:26.825065 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:26.829508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 982/1979] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:26 2022] DELETE /identity/v3/projects/fc6963b41c1a4bbe8fc43d8cb8120070 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:26.831143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:26.833776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:26.860005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-2ca4df98-7b6e-4bb6-90db-8668dd29b8f5 None None] MFA Rules not processed for user `5b40e10c987d45c48b2dc308d174476d`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:26.864196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2ca4df98-7b6e-4bb6-90db-8668dd29b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:26.958028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638afec8-850a-49ea-9cc0-63633a47ecd4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:27.083629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 998/1980] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:27.084699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4df98-7b6e-4bb6-90db-8668dd29b8f5 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:27.099020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2ca4df98-7b6e-4bb6-90db-8668dd29b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:27.155808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:27.156665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:27.156955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:27.157234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] PATH_INFO: `/v3/users/23f07bdcfe9f4c4aa5892a7eb92ab8fb` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:27.159393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f07bdcfe9f4c4aa5892a7eb92ab8fb)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:27.163570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:27.255592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f07bdcfe9f4c4aa5892a7eb92ab8fb'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.266048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4df98-7b6e-4bb6-90db-8668dd29b8f5 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:27.267747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f07bdcfe9f4c4aa5892a7eb92ab8fb'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.283182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f07bdcfe9f4c4aa5892a7eb92ab8fb'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.292984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554941aa-f593-42e4-be1b-771dac8f9780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:27.293646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554941aa-f593-42e4-be1b-771dac8f9780 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:27.293914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554941aa-f593-42e4-be1b-771dac8f9780 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:27.294185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554941aa-f593-42e4-be1b-771dac8f9780 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:27.294945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554941aa-f593-42e4-be1b-771dac8f9780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:27.296895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554941aa-f593-42e4-be1b-771dac8f9780 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:27.308204 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f07bdcfe9f4c4aa5892a7eb92ab8fb'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.310375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f07bdcfe9f4c4aa5892a7eb92ab8fb'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.320714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 983/1981] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:26 2022] DELETE /identity/v3/users/23f07bdcfe9f4c4aa5892a7eb92ab8fb => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:27.331939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 999/1982] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:27 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:27.337968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:27.343709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:27.405715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:27.468544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f820c1-1b9e-4c96-a50a-e29713c3befa admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:27.558977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554941aa-f593-42e4-be1b-771dac8f9780 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:27.560325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-554941aa-f593-42e4-be1b-771dac8f9780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:27.560626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72aa1b-e4b3-4ad4-8a77-530c63e14072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:27.561369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72aa1b-e4b3-4ad4-8a77-530c63e14072 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:27.561576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72aa1b-e4b3-4ad4-8a77-530c63e14072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:27.561860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72aa1b-e4b3-4ad4-8a77-530c63e14072 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:27.562706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72aa1b-e4b3-4ad4-8a77-530c63e14072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:27.568443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72aa1b-e4b3-4ad4-8a77-530c63e14072 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:27.579114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554941aa-f593-42e4-be1b-771dac8f9780 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:27.585623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:27.586602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:27.586895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:27.587795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] PATH_INFO: `/v3/projects/1c6b6d5868694299a94c487dbc27ceb1` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:27.590368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6b6d5868694299a94c487dbc27ceb1)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:27.592390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:27.608958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 984/1983] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:27 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:27.610038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72aa1b-e4b3-4ad4-8a77-530c63e14072 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:27.624467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72aa1b-e4b3-4ad4-8a77-530c63e14072 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:27.644545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd46d8-444a-4216-85e8-a325e25e7f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:27.645420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd46d8-444a-4216-85e8-a325e25e7f16 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:27.645767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd46d8-444a-4216-85e8-a325e25e7f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:27.646097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd46d8-444a-4216-85e8-a325e25e7f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:27.646794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd46d8-444a-4216-85e8-a325e25e7f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:27.652464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd46d8-444a-4216-85e8-a325e25e7f16 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:27.668458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 985/1984] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:27.672488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:27.673016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd46d8-444a-4216-85e8-a325e25e7f16 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:27.684949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd46d8-444a-4216-85e8-a325e25e7f16 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:27.714213 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6b6d5868694299a94c487dbc27ceb1', 'request_id': 'req-353c712f-320d-4c4a-9fca-867013a67e5c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.731868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6b6d5868694299a94c487dbc27ceb1', 'request_id': 'req-353c712f-320d-4c4a-9fca-867013a67e5c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.746753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6b6d5868694299a94c487dbc27ceb1', 'request_id': 'req-353c712f-320d-4c4a-9fca-867013a67e5c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.768130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa862-b91a-42df-8a39-bd18d2a57c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:27.768780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa862-b91a-42df-8a39-bd18d2a57c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:27.769087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa862-b91a-42df-8a39-bd18d2a57c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:27.769364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa862-b91a-42df-8a39-bd18d2a57c1b admin admin] PATH_INFO: `/v3/projects/eb7192b1c75f431bbfb7b02c8b76c678/users/cbcbf8e631034d848876d2df17e563a2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:27.771844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] The token cache is being invalidate because project 1c6b6d5868694299a94c487dbc27ceb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:27.772142 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.773175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:27.775550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1000/1985] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:27 2022] DELETE /identity/v3/projects/1c6b6d5868694299a94c487dbc27ceb1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:27.779631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:27.784424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:27.787912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa862-b91a-42df-8a39-bd18d2a57c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7192b1c75f431bbfb7b02c8b76c678, user_id=cbcbf8e631034d848876d2df17e563a2, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:27.791513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa862-b91a-42df-8a39-bd18d2a57c1b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:27.816392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 986/1986] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:27 2022] PUT /identity/v3/projects/eb7192b1c75f431bbfb7b02c8b76c678/users/cbcbf8e631034d848876d2df17e563a2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:27.820483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c712f-320d-4c4a-9fca-867013a67e5c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:27.823273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa862-b91a-42df-8a39-bd18d2a57c1b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:27.829257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a74aa862-b91a-42df-8a39-bd18d2a57c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:27.904959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:27.942975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa862-b91a-42df-8a39-bd18d2a57c1b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:27.956409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5074f-0903-4d67-91c2-6f0f804de5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:27.957157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5074f-0903-4d67-91c2-6f0f804de5ea admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:27.957898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5074f-0903-4d67-91c2-6f0f804de5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:27.958510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5074f-0903-4d67-91c2-6f0f804de5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:27.959033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:27.959687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:27.959806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5074f-0903-4d67-91c2-6f0f804de5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:27.959964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:27.960252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] PATH_INFO: `/v3/users/839a0168460d4b458b6665b3a1a53274` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:27.962007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839a0168460d4b458b6665b3a1a53274)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:27.964017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:27.964231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5074f-0903-4d67-91c2-6f0f804de5ea admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:27.990889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 987/1987] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:27.990889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5074f-0903-4d67-91c2-6f0f804de5ea admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:27.992890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-13e5074f-0903-4d67-91c2-6f0f804de5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:28.012672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5074f-0903-4d67-91c2-6f0f804de5ea admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:28.025010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:28.026528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.026742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.027183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] PATH_INFO: `/v3/projects/4e1cb081c8b54f36a6bbf59c084f1ced` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.029830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1cb081c8b54f36a6bbf59c084f1ced)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:28.033418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:28.038720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839a0168460d4b458b6665b3a1a53274'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.039694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839a0168460d4b458b6665b3a1a53274'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.053486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839a0168460d4b458b6665b3a1a53274'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.069791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839a0168460d4b458b6665b3a1a53274'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.070860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839a0168460d4b458b6665b3a1a53274'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.112079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1001/1988] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:27 2022] DELETE /identity/v3/users/839a0168460d4b458b6665b3a1a53274 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:28.113059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:28.114885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:28.131745 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1cb081c8b54f36a6bbf59c084f1ced', 'request_id': 'req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.143384 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1cb081c8b54f36a6bbf59c084f1ced', 'request_id': 'req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.159529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1cb081c8b54f36a6bbf59c084f1ced', 'request_id': 'req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.176343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] The token cache is being invalidate because project 4e1cb081c8b54f36a6bbf59c084f1ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:28.176343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.177175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ce8e9950-4e80-4bb0-a3fe-729aad2f7193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.179014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 988/1989] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:27 2022] DELETE /identity/v3/projects/4e1cb081c8b54f36a6bbf59c084f1ced => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:28.185533 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556805e8-b2ae-4766-baa1-fba2a3b908d6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.185824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556805e8-b2ae-4766-baa1-fba2a3b908d6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.186169 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556805e8-b2ae-4766-baa1-fba2a3b908d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.195232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:28.215599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-556805e8-b2ae-4766-baa1-fba2a3b908d6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:28.217098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-556805e8-b2ae-4766-baa1-fba2a3b908d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:28.243620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf6ed3-1546-44db-b1fc-4612cf94ad54 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:28.355226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 989/1990] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:28.356999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5308c3-aaf3-49e2-8703-7cf385875aba None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.357289 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d1771-f50d-414a-a483-79c93b58d0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:28.357597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5308c3-aaf3-49e2-8703-7cf385875aba None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.357597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5308c3-aaf3-49e2-8703-7cf385875aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.358038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d1771-f50d-414a-a483-79c93b58d0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.358343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d1771-f50d-414a-a483-79c93b58d0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.358652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d1771-f50d-414a-a483-79c93b58d0fc admin admin] PATH_INFO: `/v3/projects/eb7192b1c75f431bbfb7b02c8b76c678/users/cbcbf8e631034d848876d2df17e563a2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.364395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d1771-f50d-414a-a483-79c93b58d0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7192b1c75f431bbfb7b02c8b76c678, user_id=cbcbf8e631034d848876d2df17e563a2, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:28.369819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d1771-f50d-414a-a483-79c93b58d0fc admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:28.388725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1002/1991] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:28 2022] PUT /identity/v3/projects/eb7192b1c75f431bbfb7b02c8b76c678/users/cbcbf8e631034d848876d2df17e563a2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:28.389210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6e5308c3-aaf3-49e2-8703-7cf385875aba None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:28.390556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6e5308c3-aaf3-49e2-8703-7cf385875aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:28.398598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a5dd-8857-433d-bb1c-dcc596d5fd74 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.399072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a5dd-8857-433d-bb1c-dcc596d5fd74 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.399955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a5dd-8857-433d-bb1c-dcc596d5fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.450056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-9312a5dd-8857-433d-bb1c-dcc596d5fd74 None None] MFA Rules not processed for user `cbcbf8e631034d848876d2df17e563a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:28.453221 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9312a5dd-8857-433d-bb1c-dcc596d5fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:28.498540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:28.529593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 990/1992] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:28.530926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5308c3-aaf3-49e2-8703-7cf385875aba None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:28.564972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5308c3-aaf3-49e2-8703-7cf385875aba None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:28.581607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc14f83-bb9b-44e5-bdaa-c90d4525fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:28.582573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc14f83-bb9b-44e5-bdaa-c90d4525fb27 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.583075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc14f83-bb9b-44e5-bdaa-c90d4525fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.583236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc14f83-bb9b-44e5-bdaa-c90d4525fb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.586172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc14f83-bb9b-44e5-bdaa-c90d4525fb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:28.587466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc14f83-bb9b-44e5-bdaa-c90d4525fb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:28.589991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc14f83-bb9b-44e5-bdaa-c90d4525fb27 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:28.613221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 991/1993] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:28.614257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc14f83-bb9b-44e5-bdaa-c90d4525fb27 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:28.627146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1003/1994] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:28.635279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a5dd-8857-433d-bb1c-dcc596d5fd74 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:28.637147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9312a5dd-8857-433d-bb1c-dcc596d5fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:28.637548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc14f83-bb9b-44e5-bdaa-c90d4525fb27 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:28.651407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4bd6d-75d7-417a-8e3f-266ac8c76f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:28.652044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4bd6d-75d7-417a-8e3f-266ac8c76f71 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.652325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4bd6d-75d7-417a-8e3f-266ac8c76f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.652601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4bd6d-75d7-417a-8e3f-266ac8c76f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.653261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4bd6d-75d7-417a-8e3f-266ac8c76f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:28.655328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4bd6d-75d7-417a-8e3f-266ac8c76f71 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:28.694117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 992/1995] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:28 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:28.698676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4bd6d-75d7-417a-8e3f-266ac8c76f71 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:28.724881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a5dd-8857-433d-bb1c-dcc596d5fd74 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:28.749477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:28.788205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4bd6d-75d7-417a-8e3f-266ac8c76f71 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:28.794901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e88f-cb6b-4faa-a5a1-54aaed542fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:28.795534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e88f-cb6b-4faa-a5a1-54aaed542fae admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.796012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e88f-cb6b-4faa-a5a1-54aaed542fae admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.796303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e88f-cb6b-4faa-a5a1-54aaed542fae admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.796936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44e88f-cb6b-4faa-a5a1-54aaed542fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:28.797040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33830059-201b-475f-a750-65a212079499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:28.797797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33830059-201b-475f-a750-65a212079499 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.798144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33830059-201b-475f-a750-65a212079499 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.798497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33830059-201b-475f-a750-65a212079499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.798967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44e88f-cb6b-4faa-a5a1-54aaed542fae admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:28.800421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-33830059-201b-475f-a750-65a212079499 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:28.838015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 993/1996] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:28 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:28.838015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e88f-cb6b-4faa-a5a1-54aaed542fae admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:28.838015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ff44e88f-cb6b-4faa-a5a1-54aaed542fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:28.853515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e88f-cb6b-4faa-a5a1-54aaed542fae admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:28.858297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:28.858965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.859255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.859529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] PATH_INFO: `/v3/projects/376669887af242f8b0d287c5168c03de` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.860644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=376669887af242f8b0d287c5168c03de)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:28.862610 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:28.885355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33830059-201b-475f-a750-65a212079499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:28.887019 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33830059-201b-475f-a750-65a212079499 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:28.898115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1004/1997] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:28.898883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33830059-201b-475f-a750-65a212079499 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:28.910542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33830059-201b-475f-a750-65a212079499 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:28.917953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376669887af242f8b0d287c5168c03de', 'request_id': 'req-11e0e668-1eab-4003-af95-b610cb10c66c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.925039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376669887af242f8b0d287c5168c03de', 'request_id': 'req-11e0e668-1eab-4003-af95-b610cb10c66c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.939147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376669887af242f8b0d287c5168c03de', 'request_id': 'req-11e0e668-1eab-4003-af95-b610cb10c66c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.954186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] The token cache is being invalidate because project 376669887af242f8b0d287c5168c03de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:28.954486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.955634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-11e0e668-1eab-4003-af95-b610cb10c66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:28.957318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 994/1998] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:28 2022] DELETE /identity/v3/projects/376669887af242f8b0d287c5168c03de => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:28.963134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7746a8-b480-49f6-9119-d21f86828736 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.963421 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7746a8-b480-49f6-9119-d21f86828736 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.963700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7746a8-b480-49f6-9119-d21f86828736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.989806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-da7746a8-b480-49f6-9119-d21f86828736 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:28.991101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-da7746a8-b480-49f6-9119-d21f86828736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:28.994178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046958a-fa3e-48f2-9179-d2873a7153e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:28.994898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046958a-fa3e-48f2-9179-d2873a7153e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:28.995181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046958a-fa3e-48f2-9179-d2873a7153e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:28.995454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046958a-fa3e-48f2-9179-d2873a7153e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:28.996950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046958a-fa3e-48f2-9179-d2873a7153e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:28.999921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046958a-fa3e-48f2-9179-d2873a7153e4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.002224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 995/1999] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:29.010911 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f584dd4-d6ab-44bc-ba25-c5e213df2683 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.011544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f584dd4-d6ab-44bc-ba25-c5e213df2683 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.011908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f584dd4-d6ab-44bc-ba25-c5e213df2683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.020519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1005/2000] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:29.026467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046958a-fa3e-48f2-9179-d2873a7153e4 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.034369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c046958a-fa3e-48f2-9179-d2873a7153e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:29.038664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1f584dd4-d6ab-44bc-ba25-c5e213df2683 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:29.040534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1f584dd4-d6ab-44bc-ba25-c5e213df2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:29.048857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046958a-fa3e-48f2-9179-d2873a7153e4 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.050882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 996/2001] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:29.053508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f584dd4-d6ab-44bc-ba25-c5e213df2683 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.056363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdba61-d88c-4446-bd48-81ca11f550ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.057139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdba61-d88c-4446-bd48-81ca11f550ff admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.057428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdba61-d88c-4446-bd48-81ca11f550ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.057701 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdba61-d88c-4446-bd48-81ca11f550ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.058354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdba61-d88c-4446-bd48-81ca11f550ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.060146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdba61-d88c-4446-bd48-81ca11f550ff admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.065046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f584dd4-d6ab-44bc-ba25-c5e213df2683 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.070667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b1293-6031-4986-b5bb-a698af30a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.071283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1006/2002] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:29.071718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b1293-6031-4986-b5bb-a698af30a95c admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.072232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b1293-6031-4986-b5bb-a698af30a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.072578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b1293-6031-4986-b5bb-a698af30a95c admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.073306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b1293-6031-4986-b5bb-a698af30a95c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:29.073679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b1293-6031-4986-b5bb-a698af30a95c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.075448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdba61-d88c-4446-bd48-81ca11f550ff admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.075584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b1293-6031-4986-b5bb-a698af30a95c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.086267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdba61-d88c-4446-bd48-81ca11f550ff admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.090885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 997/2003] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:48:29.093401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b1293-6031-4986-b5bb-a698af30a95c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.093644 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea96ff-fdd3-4e17-a915-38fdd215cd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.094354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea96ff-fdd3-4e17-a915-38fdd215cd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.094637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea96ff-fdd3-4e17-a915-38fdd215cd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.094948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea96ff-fdd3-4e17-a915-38fdd215cd47 admin admin] PATH_INFO: `/v3/projects/20342ee1f65e4d5c930f540cfed80645/users/fefd1c013c3d4b4697c9754b0d75697c/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.105548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b1293-6031-4986-b5bb-a698af30a95c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.112696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9530a-1c88-4359-a0fa-a20630a87442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.113725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9530a-1c88-4359-a0fa-a20630a87442 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.114072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9530a-1c88-4359-a0fa-a20630a87442 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.114438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9530a-1c88-4359-a0fa-a20630a87442 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.115153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9530a-1c88-4359-a0fa-a20630a87442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.115574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea96ff-fdd3-4e17-a915-38fdd215cd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20342ee1f65e4d5c930f540cfed80645, user_id=fefd1c013c3d4b4697c9754b0d75697c, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.117201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9530a-1c88-4359-a0fa-a20630a87442 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.119472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea96ff-fdd3-4e17-a915-38fdd215cd47 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.123192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:29.139004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1007/2004] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:29 2022] PUT /identity/v3/projects/20342ee1f65e4d5c930f540cfed80645/users/fefd1c013c3d4b4697c9754b0d75697c/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:29.151514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401a81-f836-4132-a212-fc4ad23ebc30 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.151971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401a81-f836-4132-a212-fc4ad23ebc30 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.152303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401a81-f836-4132-a212-fc4ad23ebc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.163507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 998/2005] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:29 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:29.169061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9530a-1c88-4359-a0fa-a20630a87442 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.199030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-49401a81-f836-4132-a212-fc4ad23ebc30 None None] MFA Rules not processed for user `fefd1c013c3d4b4697c9754b0d75697c`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:29.200273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-49401a81-f836-4132-a212-fc4ad23ebc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:29.237331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:29.258109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9530a-1c88-4359-a0fa-a20630a87442 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.265039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e26562-bd5e-45f9-be9b-783e02339557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.265829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e26562-bd5e-45f9-be9b-783e02339557 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.266175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e26562-bd5e-45f9-be9b-783e02339557 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.266561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e26562-bd5e-45f9-be9b-783e02339557 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.267574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e26562-bd5e-45f9-be9b-783e02339557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.270156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e26562-bd5e-45f9-be9b-783e02339557 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.309080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 999/2006] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:29 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:29.309799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e26562-bd5e-45f9-be9b-783e02339557 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.316494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1008/2007] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:29.320307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e26562-bd5e-45f9-be9b-783e02339557 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.325362 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa356349-b310-40d5-aed4-ad61a708600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.326101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa356349-b310-40d5-aed4-ad61a708600f admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.326341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa356349-b310-40d5-aed4-ad61a708600f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.326508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa356349-b310-40d5-aed4-ad61a708600f admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.327188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa356349-b310-40d5-aed4-ad61a708600f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.327713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49401a81-f836-4132-a212-fc4ad23ebc30 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.328790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa356349-b310-40d5-aed4-ad61a708600f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.329232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-49401a81-f836-4132-a212-fc4ad23ebc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:29.342818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1000/2008] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:29.345145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa356349-b310-40d5-aed4-ad61a708600f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.359117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa356349-b310-40d5-aed4-ad61a708600f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.365865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6241b2-f9bd-4af1-96aa-6d20b74b582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.366898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6241b2-f9bd-4af1-96aa-6d20b74b582e admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.367393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6241b2-f9bd-4af1-96aa-6d20b74b582e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.367694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6241b2-f9bd-4af1-96aa-6d20b74b582e admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.368472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6241b2-f9bd-4af1-96aa-6d20b74b582e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.370968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6241b2-f9bd-4af1-96aa-6d20b74b582e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.388728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1001/2009] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:29.389933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6241b2-f9bd-4af1-96aa-6d20b74b582e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.404471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6241b2-f9bd-4af1-96aa-6d20b74b582e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.409370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49401a81-f836-4132-a212-fc4ad23ebc30 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.409947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018a7f2-460e-49c4-b5bc-08b3dbb9fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.410617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018a7f2-460e-49c4-b5bc-08b3dbb9fc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.410947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018a7f2-460e-49c4-b5bc-08b3dbb9fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.411237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018a7f2-460e-49c4-b5bc-08b3dbb9fc7d admin admin] PATH_INFO: `/v3/projects/99db8674d79b46a49f1743bc5b21581e/users/f79f0658f5454b04bdbe7192221325ca/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.413471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a4131-4387-4be5-865b-3e551ebe265a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.414120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a4131-4387-4be5-865b-3e551ebe265a service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.414488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a4131-4387-4be5-865b-3e551ebe265a service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.414680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a4131-4387-4be5-865b-3e551ebe265a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.424794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a4131-4387-4be5-865b-3e551ebe265a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.426466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a4131-4387-4be5-865b-3e551ebe265a service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.429327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018a7f2-460e-49c4-b5bc-08b3dbb9fc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99db8674d79b46a49f1743bc5b21581e, user_id=f79f0658f5454b04bdbe7192221325ca, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.432595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018a7f2-460e-49c4-b5bc-08b3dbb9fc7d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.439126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1009/2010] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:29.466348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1002/2011] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:29 2022] PUT /identity/v3/projects/99db8674d79b46a49f1743bc5b21581e/users/f79f0658f5454b04bdbe7192221325ca/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:29.466793 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a4131-4387-4be5-865b-3e551ebe265a service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.470543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ccb4-fba6-4e45-8a29-f95ae7edcfa9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.470924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ccb4-fba6-4e45-8a29-f95ae7edcfa9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.471281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ccb4-fba6-4e45-8a29-f95ae7edcfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.474931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a4131-4387-4be5-865b-3e551ebe265a service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.502616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0fa0ccb4-fba6-4e45-8a29-f95ae7edcfa9 None None] MFA Rules not processed for user `f79f0658f5454b04bdbe7192221325ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:29.503925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0fa0ccb4-fba6-4e45-8a29-f95ae7edcfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:29.564446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.564446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.564860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.564993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] PATH_INFO: `/v3/users/fefd1c013c3d4b4697c9754b0d75697c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.566151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefd1c013c3d4b4697c9754b0d75697c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.568174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.609412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1003/2012] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:29.613762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0ccb4-fba6-4e45-8a29-f95ae7edcfa9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.625489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefd1c013c3d4b4697c9754b0d75697c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:29.625797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0ccb4-fba6-4e45-8a29-f95ae7edcfa9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.626164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefd1c013c3d4b4697c9754b0d75697c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:29.631529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15f16-a249-477e-9640-cfcea44a614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.632127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15f16-a249-477e-9640-cfcea44a614e admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.632404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15f16-a249-477e-9640-cfcea44a614e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.632673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15f16-a249-477e-9640-cfcea44a614e admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.633328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a15f16-a249-477e-9640-cfcea44a614e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.636451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a15f16-a249-477e-9640-cfcea44a614e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.641541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefd1c013c3d4b4697c9754b0d75697c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:29.643473 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:29.652000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefd1c013c3d4b4697c9754b0d75697c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:29.653465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0eefe5d0-0b6b-42ec-93d8-a6cedf57767f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefd1c013c3d4b4697c9754b0d75697c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:29.656034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:29.669218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1010/2013] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:29 2022] DELETE /identity/v3/users/fefd1c013c3d4b4697c9754b0d75697c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:29.671865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1004/2014] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:29 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:29.673779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594bde5-347a-4bf2-a6b9-567487a73a66 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.674134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594bde5-347a-4bf2-a6b9-567487a73a66 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.674414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594bde5-347a-4bf2-a6b9-567487a73a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.675311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15f16-a249-477e-9640-cfcea44a614e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.677074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d6a15f16-a249-477e-9640-cfcea44a614e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:29.693490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a594bde5-347a-4bf2-a6b9-567487a73a66 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:29.694703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a594bde5-347a-4bf2-a6b9-567487a73a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:29.741768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15f16-a249-477e-9640-cfcea44a614e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.746728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c112d-c75a-40e4-bd67-8ab004834a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.747368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c112d-c75a-40e4-bd67-8ab004834a49 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.747649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c112d-c75a-40e4-bd67-8ab004834a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.747924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c112d-c75a-40e4-bd67-8ab004834a49 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.748552 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c112d-c75a-40e4-bd67-8ab004834a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.750557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c112d-c75a-40e4-bd67-8ab004834a49 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.755329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1011/2015] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:29.766533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594bde5-347a-4bf2-a6b9-567487a73a66 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.768282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a594bde5-347a-4bf2-a6b9-567487a73a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:29.776918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1005/2016] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:29 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:29.777916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c112d-c75a-40e4-bd67-8ab004834a49 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.787601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c112d-c75a-40e4-bd67-8ab004834a49 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.792907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9135a-b87f-49c7-a5d1-4dde635b6a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.793518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9135a-b87f-49c7-a5d1-4dde635b6a9f admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.793851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9135a-b87f-49c7-a5d1-4dde635b6a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.794125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9135a-b87f-49c7-a5d1-4dde635b6a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.794914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9135a-b87f-49c7-a5d1-4dde635b6a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.796551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9135a-b87f-49c7-a5d1-4dde635b6a9f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.806991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1006/2017] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:29.810980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9135a-b87f-49c7-a5d1-4dde635b6a9f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.820775 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9135a-b87f-49c7-a5d1-4dde635b6a9f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.826021 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d258c-f25d-4ff1-a99f-2151f09c8ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.826621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d258c-f25d-4ff1-a99f-2151f09c8ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.826942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d258c-f25d-4ff1-a99f-2151f09c8ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.827224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d258c-f25d-4ff1-a99f-2151f09c8ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.827852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d258c-f25d-4ff1-a99f-2151f09c8ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.829445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d258c-f25d-4ff1-a99f-2151f09c8ba1 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.830479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594bde5-347a-4bf2-a6b9-567487a73a66 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.834268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198a42f-426c-46da-b632-2073b2e7d3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.834946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a42f-426c-46da-b632-2073b2e7d3de service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.835226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a42f-426c-46da-b632-2073b2e7d3de service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.835496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a42f-426c-46da-b632-2073b2e7d3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.841194 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1007/2018] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:29.845488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d258c-f25d-4ff1-a99f-2151f09c8ba1 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:29.847350 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198a42f-426c-46da-b632-2073b2e7d3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.848824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198a42f-426c-46da-b632-2073b2e7d3de service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.857885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d258c-f25d-4ff1-a99f-2151f09c8ba1 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:29.862980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7bf67-a644-459a-819f-3fce798ee137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:29.863659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7bf67-a644-459a-819f-3fce798ee137 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.864084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7bf67-a644-459a-819f-3fce798ee137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.864367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7bf67-a644-459a-819f-3fce798ee137 admin admin] PATH_INFO: `/v3/projects/385beb9bb9d14a54acfbbb446f050985/users/4689b5b5609740b88c3cc4719cb8afc4/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:29.869760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1012/2019] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:29.903881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7bf67-a644-459a-819f-3fce798ee137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385beb9bb9d14a54acfbbb446f050985, user_id=4689b5b5609740b88c3cc4719cb8afc4, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:29.909543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7bf67-a644-459a-819f-3fce798ee137 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:29.926788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1008/2020] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:29 2022] PUT /identity/v3/projects/385beb9bb9d14a54acfbbb446f050985/users/4689b5b5609740b88c3cc4719cb8afc4/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:29.939543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9719-18b5-4e13-8132-a40f349228dc None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:29.939824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9719-18b5-4e13-8132-a40f349228dc None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:29.940405 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9719-18b5-4e13-8132-a40f349228dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.006925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-edda9719-18b5-4e13-8132-a40f349228dc None None] MFA Rules not processed for user `4689b5b5609740b88c3cc4719cb8afc4`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:30.008147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-edda9719-18b5-4e13-8132-a40f349228dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:30.112043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1013/2021] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:30.116469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7bf67-a644-459a-819f-3fce798ee137 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:30.211883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7bf67-a644-459a-819f-3fce798ee137 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:30.216993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960b204-2882-4247-ab9b-e2b930c2dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:30.217616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960b204-2882-4247-ab9b-e2b930c2dc99 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.217894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960b204-2882-4247-ab9b-e2b930c2dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.218163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960b204-2882-4247-ab9b-e2b930c2dc99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.218812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960b204-2882-4247-ab9b-e2b930c2dc99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:30.220720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960b204-2882-4247-ab9b-e2b930c2dc99 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:30.266977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1009/2022] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:30 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:30.269152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda9719-18b5-4e13-8132-a40f349228dc None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:30.283085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda9719-18b5-4e13-8132-a40f349228dc None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:30.288977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960b204-2882-4247-ab9b-e2b930c2dc99 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:30.291737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6960b204-2882-4247-ab9b-e2b930c2dc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:30.312059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:30.337940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:30.381812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960b204-2882-4247-ab9b-e2b930c2dc99 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:30.387697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87652e37-7b44-440a-a748-142197fb9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:30.388330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87652e37-7b44-440a-a748-142197fb9638 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.388610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87652e37-7b44-440a-a748-142197fb9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.389258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87652e37-7b44-440a-a748-142197fb9638 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.389984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87652e37-7b44-440a-a748-142197fb9638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:30.391104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:30.391594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.391889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87652e37-7b44-440a-a748-142197fb9638 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:30.391992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.392269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] PATH_INFO: `/v3/projects/20342ee1f65e4d5c930f540cfed80645` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.393492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20342ee1f65e4d5c930f540cfed80645)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:30.395624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:30.421534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1014/2023] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:30 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:30.423258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87652e37-7b44-440a-a748-142197fb9638 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:30.439151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87652e37-7b44-440a-a748-142197fb9638 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:30.445474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99774ea-a44d-4cc4-bc57-62fa4f27ae0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:30.446433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99774ea-a44d-4cc4-bc57-62fa4f27ae0e admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.446847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99774ea-a44d-4cc4-bc57-62fa4f27ae0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.448015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99774ea-a44d-4cc4-bc57-62fa4f27ae0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.448771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99774ea-a44d-4cc4-bc57-62fa4f27ae0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:30.451214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99774ea-a44d-4cc4-bc57-62fa4f27ae0e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:30.458618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20342ee1f65e4d5c930f540cfed80645', 'request_id': 'req-89104a8d-4858-4b50-909e-73600327ec0e'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:30.468920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1015/2024] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:30.469151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20342ee1f65e4d5c930f540cfed80645', 'request_id': 'req-89104a8d-4858-4b50-909e-73600327ec0e'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:30.471068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99774ea-a44d-4cc4-bc57-62fa4f27ae0e admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:30.475640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20342ee1f65e4d5c930f540cfed80645', 'request_id': 'req-89104a8d-4858-4b50-909e-73600327ec0e'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:30.489804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99774ea-a44d-4cc4-bc57-62fa4f27ae0e admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:30.490076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] The token cache is being invalidate because project 20342ee1f65e4d5c930f540cfed80645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:30.490171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:30.490898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-89104a8d-4858-4b50-909e-73600327ec0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:30.492652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1010/2025] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:30 2022] DELETE /identity/v3/projects/20342ee1f65e4d5c930f540cfed80645 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:30.499294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568b164-cb6e-4330-b20d-fc4fcd1ab560 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.501830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568b164-cb6e-4330-b20d-fc4fcd1ab560 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.502138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568b164-cb6e-4330-b20d-fc4fcd1ab560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.530908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5568b164-cb6e-4330-b20d-fc4fcd1ab560 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:30.531835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5568b164-cb6e-4330-b20d-fc4fcd1ab560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:30.575794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa31b26-10a2-4c59-8605-9bbf759c5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:30.576575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa31b26-10a2-4c59-8605-9bbf759c5a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.576955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa31b26-10a2-4c59-8605-9bbf759c5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.577132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa31b26-10a2-4c59-8605-9bbf759c5a66 admin admin] PATH_INFO: `/v3/projects/dd28e49114bb4cc2947f9c48f741abc5/users/4d7ebf1b23fc479eb0be43cad23dd55a/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.611747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa31b26-10a2-4c59-8605-9bbf759c5a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd28e49114bb4cc2947f9c48f741abc5, user_id=4d7ebf1b23fc479eb0be43cad23dd55a, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:30.615761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa31b26-10a2-4c59-8605-9bbf759c5a66 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:30.635678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1016/2026] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:30 2022] PUT /identity/v3/projects/dd28e49114bb4cc2947f9c48f741abc5/users/4d7ebf1b23fc479eb0be43cad23dd55a/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:30.638629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1011/2027] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:30.640744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa31b26-10a2-4c59-8605-9bbf759c5a66 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:30.644522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0fa31b26-10a2-4c59-8605-9bbf759c5a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:30.650817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f999d8d-93be-40ba-acea-e70bbef0cee4 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.650817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f999d8d-93be-40ba-acea-e70bbef0cee4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.650817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f999d8d-93be-40ba-acea-e70bbef0cee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.678692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6f999d8d-93be-40ba-acea-e70bbef0cee4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:30.680017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6f999d8d-93be-40ba-acea-e70bbef0cee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:30.739928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:30.751156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa31b26-10a2-4c59-8605-9bbf759c5a66 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:30.757542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1012/2028] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:30.760919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692eda1-d533-4e79-be10-db02281316b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:30.762190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692eda1-d533-4e79-be10-db02281316b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.762714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692eda1-d533-4e79-be10-db02281316b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.762978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f999d8d-93be-40ba-acea-e70bbef0cee4 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:30.763428 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692eda1-d533-4e79-be10-db02281316b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.764433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692eda1-d533-4e79-be10-db02281316b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:30.768073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692eda1-d533-4e79-be10-db02281316b7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:30.780365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f999d8d-93be-40ba-acea-e70bbef0cee4 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:30.785357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376081f-3565-4229-95b0-f6694492e7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:30.786346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376081f-3565-4229-95b0-f6694492e7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.786629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376081f-3565-4229-95b0-f6694492e7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.787353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376081f-3565-4229-95b0-f6694492e7f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.788023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376081f-3565-4229-95b0-f6694492e7f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:30.788331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376081f-3565-4229-95b0-f6694492e7f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:30.790750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376081f-3565-4229-95b0-f6694492e7f8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:30.794573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1017/2029] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:30.795918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692eda1-d533-4e79-be10-db02281316b7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:30.808010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1013/2030] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:48:30.808202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692eda1-d533-4e79-be10-db02281316b7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:30.809677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376081f-3565-4229-95b0-f6694492e7f8 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:30.813159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58435c-823c-4cb7-98de-fcc103d02160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:30.813986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58435c-823c-4cb7-98de-fcc103d02160 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.814268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58435c-823c-4cb7-98de-fcc103d02160 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.814642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58435c-823c-4cb7-98de-fcc103d02160 admin admin] PATH_INFO: `/v3/projects/dd28e49114bb4cc2947f9c48f741abc5/users/4d7ebf1b23fc479eb0be43cad23dd55a/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.816492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58435c-823c-4cb7-98de-fcc103d02160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd28e49114bb4cc2947f9c48f741abc5, user_id=4d7ebf1b23fc479eb0be43cad23dd55a, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:30.819210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58435c-823c-4cb7-98de-fcc103d02160 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:30.826785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376081f-3565-4229-95b0-f6694492e7f8 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:30.827757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:30.843699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1018/2031] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:30 2022] PUT /identity/v3/projects/dd28e49114bb4cc2947f9c48f741abc5/users/4d7ebf1b23fc479eb0be43cad23dd55a/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:30.847408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820ee61-c74b-4268-b196-964167fdf12c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.847958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820ee61-c74b-4268-b196-964167fdf12c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.848483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820ee61-c74b-4268-b196-964167fdf12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.894542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d820ee61-c74b-4268-b196-964167fdf12c None None] MFA Rules not processed for user `4d7ebf1b23fc479eb0be43cad23dd55a`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:30.895854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d820ee61-c74b-4268-b196-964167fdf12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:30.935215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85b184-5efa-43ad-8fc9-5b84f903da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:30.936356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85b184-5efa-43ad-8fc9-5b84f903da40 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:30.937370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85b184-5efa-43ad-8fc9-5b84f903da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:30.937892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85b184-5efa-43ad-8fc9-5b84f903da40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:30.939797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85b184-5efa-43ad-8fc9-5b84f903da40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:30.942278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85b184-5efa-43ad-8fc9-5b84f903da40 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:30.992620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1014/2032] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:30 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:30.995327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85b184-5efa-43ad-8fc9-5b84f903da40 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:31.012038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1019/2033] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:31.029171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820ee61-c74b-4268-b196-964167fdf12c None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:31.031556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d820ee61-c74b-4268-b196-964167fdf12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:31.098580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85b184-5efa-43ad-8fc9-5b84f903da40 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:31.109502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe2be8-583e-42e1-bfcb-71495e5bbe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:31.110991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe2be8-583e-42e1-bfcb-71495e5bbe25 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:31.111344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe2be8-583e-42e1-bfcb-71495e5bbe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:31.112374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe2be8-583e-42e1-bfcb-71495e5bbe25 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:31.113549 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe2be8-583e-42e1-bfcb-71495e5bbe25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:31.116224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe2be8-583e-42e1-bfcb-71495e5bbe25 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:31.130881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820ee61-c74b-4268-b196-964167fdf12c None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:31.149343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1015/2034] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:30 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:31.160793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe2be8-583e-42e1-bfcb-71495e5bbe25 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:31.173702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe2be8-583e-42e1-bfcb-71495e5bbe25 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:31.177411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4473a2-c641-4ad5-8059-38eca3205ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:31.178288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4473a2-c641-4ad5-8059-38eca3205ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:31.178588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4473a2-c641-4ad5-8059-38eca3205ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:31.179072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4473a2-c641-4ad5-8059-38eca3205ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:31.179795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4473a2-c641-4ad5-8059-38eca3205ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:31.182542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4473a2-c641-4ad5-8059-38eca3205ad0 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:31.195789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1016/2035] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:31.203701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4473a2-c641-4ad5-8059-38eca3205ad0 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:31.231168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4473a2-c641-4ad5-8059-38eca3205ad0 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:31.251048 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b05bd3-69fd-4e78-907c-dca2d78c66a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:31.252074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b05bd3-69fd-4e78-907c-dca2d78c66a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:31.252556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b05bd3-69fd-4e78-907c-dca2d78c66a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:31.253041 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b05bd3-69fd-4e78-907c-dca2d78c66a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:31.254139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b05bd3-69fd-4e78-907c-dca2d78c66a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:31.256600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b05bd3-69fd-4e78-907c-dca2d78c66a9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:31.292041 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1017/2036] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:31.293007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b05bd3-69fd-4e78-907c-dca2d78c66a9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:31.306992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b05bd3-69fd-4e78-907c-dca2d78c66a9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:31.309810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:31.310695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:31.311167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:31.312316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:31.314913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:31.320084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a64460-058f-4726-9dd0-2c68c0e3eec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:31.321643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a64460-058f-4726-9dd0-2c68c0e3eec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:31.322029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a64460-058f-4726-9dd0-2c68c0e3eec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:31.322539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a64460-058f-4726-9dd0-2c68c0e3eec2 admin admin] PATH_INFO: `/v3/projects/fc7438e409d44933918074e11e8e2942/users/e8bb1081a07e418497586343455b1cfb/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:31.355373 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a64460-058f-4726-9dd0-2c68c0e3eec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7438e409d44933918074e11e8e2942, user_id=e8bb1081a07e418497586343455b1cfb, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:31.360640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a64460-058f-4726-9dd0-2c68c0e3eec2 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:31.377880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1018/2037] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:31 2022] PUT /identity/v3/projects/fc7438e409d44933918074e11e8e2942/users/e8bb1081a07e418497586343455b1cfb/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:31.393482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09eb3d-ef32-4507-9fe4-adfa764b8bd6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:31.394067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09eb3d-ef32-4507-9fe4-adfa764b8bd6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:31.394331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09eb3d-ef32-4507-9fe4-adfa764b8bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:31.441614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:31.447724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:31.461547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:31.471201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6e09eb3d-ef32-4507-9fe4-adfa764b8bd6 None None] MFA Rules not processed for user `e8bb1081a07e418497586343455b1cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:31.472686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6e09eb3d-ef32-4507-9fe4-adfa764b8bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:31.480391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:31.514219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1020/2038] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:31.626106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1019/2039] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:31.713102 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:31.714853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:31.726895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ee002-4d77-4d15-beb6-6adf10c3fad6 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:31.802369 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd68724-9fdb-4f7c-b88b-9ffeaf02e211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:31.803179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd68724-9fdb-4f7c-b88b-9ffeaf02e211 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:31.803425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd68724-9fdb-4f7c-b88b-9ffeaf02e211 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:31.803708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd68724-9fdb-4f7c-b88b-9ffeaf02e211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:31.815129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd68724-9fdb-4f7c-b88b-9ffeaf02e211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:31.816700 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd68724-9fdb-4f7c-b88b-9ffeaf02e211 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:31.831646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1021/2040] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:31.885969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09eb3d-ef32-4507-9fe4-adfa764b8bd6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:31.921447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09eb3d-ef32-4507-9fe4-adfa764b8bd6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:31.928949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a74c-b1c0-4db0-980d-8989b07784bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:31.931422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a74c-b1c0-4db0-980d-8989b07784bd service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:31.931422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a74c-b1c0-4db0-980d-8989b07784bd service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:31.932074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a74c-b1c0-4db0-980d-8989b07784bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:31.935644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-25f9a74c-b1c0-4db0-980d-8989b07784bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:32.016578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9a74c-b1c0-4db0-980d-8989b07784bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:32.018031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9a74c-b1c0-4db0-980d-8989b07784bd service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:32.028072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1020/2041] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:33.162702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd68724-9fdb-4f7c-b88b-9ffeaf02e211 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:33.172664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd68724-9fdb-4f7c-b88b-9ffeaf02e211 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:33.176479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084055a-1493-4c64-848e-49a003f04f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:33.177090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084055a-1493-4c64-848e-49a003f04f24 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:33.177373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084055a-1493-4c64-848e-49a003f04f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:33.177649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084055a-1493-4c64-848e-49a003f04f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:33.179407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1084055a-1493-4c64-848e-49a003f04f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:33.249082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084055a-1493-4c64-848e-49a003f04f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:33.250535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084055a-1493-4c64-848e-49a003f04f24 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:33.260938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1022/2042] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:33.994499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a74c-b1c0-4db0-980d-8989b07784bd service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:34.010850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a74c-b1c0-4db0-980d-8989b07784bd service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:34.014792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eee2e8-3022-4c8a-887e-2859b99c3c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:34.015339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eee2e8-3022-4c8a-887e-2859b99c3c1c service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:34.015570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eee2e8-3022-4c8a-887e-2859b99c3c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:34.015849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eee2e8-3022-4c8a-887e-2859b99c3c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:34.101897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eee2e8-3022-4c8a-887e-2859b99c3c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:34.105491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eee2e8-3022-4c8a-887e-2859b99c3c1c service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:34.145952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1021/2043] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:35.480596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084055a-1493-4c64-848e-49a003f04f24 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:35.637381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084055a-1493-4c64-848e-49a003f04f24 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:35.656795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:35.657466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:35.657751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:35.658023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] PATH_INFO: `/v3/users/e8bb1081a07e418497586343455b1cfb` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:35.660608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bb1081a07e418497586343455b1cfb)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:35.662515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:35.735773 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:35.746918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bb1081a07e418497586343455b1cfb'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:35.748032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bb1081a07e418497586343455b1cfb'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:35.781466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bb1081a07e418497586343455b1cfb'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:35.790524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bb1081a07e418497586343455b1cfb'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:35.791648 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bb1081a07e418497586343455b1cfb'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:35.812311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1023/2044] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:35 2022] DELETE /identity/v3/users/e8bb1081a07e418497586343455b1cfb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:35.818172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066af80-8560-4453-8227-169276ca535e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:35.818685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066af80-8560-4453-8227-169276ca535e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:35.819012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066af80-8560-4453-8227-169276ca535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:35.862754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6066af80-8560-4453-8227-169276ca535e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:35.864216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6066af80-8560-4453-8227-169276ca535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:35.909600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:35.955850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1022/2045] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:35.966502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:35.968193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:36.040743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19439c0-9991-4365-b824-7a2639c0f376 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:36.046462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df023620-f0a6-41be-b073-aca771fe7cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:36.047238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df023620-f0a6-41be-b073-aca771fe7cdd service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:36.047583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df023620-f0a6-41be-b073-aca771fe7cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:36.048202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df023620-f0a6-41be-b073-aca771fe7cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:36.058813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df023620-f0a6-41be-b073-aca771fe7cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:36.060256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df023620-f0a6-41be-b073-aca771fe7cdd service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:36.072256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1024/2046] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:36.735530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066af80-8560-4453-8227-169276ca535e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:36.737280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6066af80-8560-4453-8227-169276ca535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:36.767256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066af80-8560-4453-8227-169276ca535e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:36.777229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:36.778569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:36.778860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:36.779136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] PATH_INFO: `/v3/projects/fc7438e409d44933918074e11e8e2942` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:36.780416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7438e409d44933918074e11e8e2942)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:36.782372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:36.842046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7438e409d44933918074e11e8e2942', 'request_id': 'req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:36.850230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7438e409d44933918074e11e8e2942', 'request_id': 'req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:36.859703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7438e409d44933918074e11e8e2942', 'request_id': 'req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:36.880950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] The token cache is being invalidate because project fc7438e409d44933918074e11e8e2942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:36.882115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:36.883022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-67a98c75-78ba-4c0c-b1c2-dbbcbb6c01f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:36.886536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1023/2047] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:36 2022] DELETE /identity/v3/projects/fc7438e409d44933918074e11e8e2942 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:36.893183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804e74-a03d-448f-93f4-779fae19ac6e None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:36.893853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804e74-a03d-448f-93f4-779fae19ac6e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:36.893939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804e74-a03d-448f-93f4-779fae19ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:36.950395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-17804e74-a03d-448f-93f4-779fae19ac6e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:36.951640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-17804e74-a03d-448f-93f4-779fae19ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:37.057604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1025/2048] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:37.065474 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c92cb-743c-4602-af6e-66c50b0da871 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:37.065767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c92cb-743c-4602-af6e-66c50b0da871 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:37.066043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c92cb-743c-4602-af6e-66c50b0da871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:37.104453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1f9c92cb-743c-4602-af6e-66c50b0da871 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:37.105760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1f9c92cb-743c-4602-af6e-66c50b0da871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:37.126083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1024/2049] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:37.131171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804e74-a03d-448f-93f4-779fae19ac6e None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:37.149488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804e74-a03d-448f-93f4-779fae19ac6e None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:37.167156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d3f60-d4a5-4f2a-883e-e36155e277d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:37.169190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3f60-d4a5-4f2a-883e-e36155e277d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:37.169780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3f60-d4a5-4f2a-883e-e36155e277d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:37.170255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3f60-d4a5-4f2a-883e-e36155e277d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:37.170963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d3f60-d4a5-4f2a-883e-e36155e277d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:37.171987 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d3f60-d4a5-4f2a-883e-e36155e277d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:37.175986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d3f60-d4a5-4f2a-883e-e36155e277d4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:37.207995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1026/2050] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:37.213195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c92cb-743c-4602-af6e-66c50b0da871 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:37.225652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c92cb-743c-4602-af6e-66c50b0da871 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:37.240166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fcf52-adcd-4345-83bf-33adf1bc5b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:37.240843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fcf52-adcd-4345-83bf-33adf1bc5b30 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:37.241165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fcf52-adcd-4345-83bf-33adf1bc5b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:37.241611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fcf52-adcd-4345-83bf-33adf1bc5b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:37.242173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fcf52-adcd-4345-83bf-33adf1bc5b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:37.245515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fcf52-adcd-4345-83bf-33adf1bc5b30 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:37.294506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1025/2051] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:37 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:37.301502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d3f60-d4a5-4f2a-883e-e36155e277d4 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:37.321816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d3f60-d4a5-4f2a-883e-e36155e277d4 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:37.438380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:37.474507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30081c25-7ceb-4f42-89c9-31caa84c8d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:37.476307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081c25-7ceb-4f42-89c9-31caa84c8d36 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:37.477316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081c25-7ceb-4f42-89c9-31caa84c8d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:37.479698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081c25-7ceb-4f42-89c9-31caa84c8d36 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:37.481664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30081c25-7ceb-4f42-89c9-31caa84c8d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:37.483999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30081c25-7ceb-4f42-89c9-31caa84c8d36 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:37.526314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1027/2052] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:37 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:37.531622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fcf52-adcd-4345-83bf-33adf1bc5b30 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:37.573645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fcf52-adcd-4345-83bf-33adf1bc5b30 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:37.595507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdaa1a-c21f-49c0-89e6-296f0de3ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:37.611534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdaa1a-c21f-49c0-89e6-296f0de3ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:37.611534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdaa1a-c21f-49c0-89e6-296f0de3ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:37.611534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdaa1a-c21f-49c0-89e6-296f0de3ab1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:37.611534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdaa1a-c21f-49c0-89e6-296f0de3ab1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:37.611534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdaa1a-c21f-49c0-89e6-296f0de3ab1c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:37.662225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1026/2053] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:37.666986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30081c25-7ceb-4f42-89c9-31caa84c8d36 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:37.687730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30081c25-7ceb-4f42-89c9-31caa84c8d36 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:37.701785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90680c23-0866-4773-ba16-28d27ccf97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:37.702555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90680c23-0866-4773-ba16-28d27ccf97d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:37.706321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90680c23-0866-4773-ba16-28d27ccf97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:37.706898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90680c23-0866-4773-ba16-28d27ccf97d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:37.707810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90680c23-0866-4773-ba16-28d27ccf97d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:37.710710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90680c23-0866-4773-ba16-28d27ccf97d6 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:37.754865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1028/2054] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:37.761027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdaa1a-c21f-49c0-89e6-296f0de3ab1c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:37.784201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdaa1a-c21f-49c0-89e6-296f0de3ab1c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:37.793457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d8b2d-7b4f-4aa0-bc95-beae473475ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:37.794535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d8b2d-7b4f-4aa0-bc95-beae473475ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:37.795061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d8b2d-7b4f-4aa0-bc95-beae473475ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:37.795514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d8b2d-7b4f-4aa0-bc95-beae473475ea admin admin] PATH_INFO: `/v3/projects/3239080b68754120ab184ba96c2d7573/users/87912007a60f4314a7966f5898d5de71/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:37.841762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d8b2d-7b4f-4aa0-bc95-beae473475ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3239080b68754120ab184ba96c2d7573, user_id=87912007a60f4314a7966f5898d5de71, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:37.849798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d8b2d-7b4f-4aa0-bc95-beae473475ea admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:37.875405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1027/2055] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:37 2022] PUT /identity/v3/projects/3239080b68754120ab184ba96c2d7573/users/87912007a60f4314a7966f5898d5de71/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:37.884998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a1d7-cfe4-40b4-be9d-ea151323cf11 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:37.885397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a1d7-cfe4-40b4-be9d-ea151323cf11 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:37.885750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a1d7-cfe4-40b4-be9d-ea151323cf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:37.984977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3ea5a1d7-cfe4-40b4-be9d-ea151323cf11 None None] MFA Rules not processed for user `87912007a60f4314a7966f5898d5de71`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:37.986561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3ea5a1d7-cfe4-40b4-be9d-ea151323cf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:38.168384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1029/2056] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:38.189457 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d8b2d-7b4f-4aa0-bc95-beae473475ea admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:38.194189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-606d8b2d-7b4f-4aa0-bc95-beae473475ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:38.328392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:38.339302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d8b2d-7b4f-4aa0-bc95-beae473475ea admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:38.346008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d8c49-5289-4aad-88ff-23686a446feb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d4e9baa7a6241b1807c67844c7d424c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:38.346468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d8c49-5289-4aad-88ff-23686a446feb service glance] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:38.346836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d8c49-5289-4aad-88ff-23686a446feb service glance] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:38.347111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d8c49-5289-4aad-88ff-23686a446feb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:38.362492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d8c49-5289-4aad-88ff-23686a446feb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:38.367436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d8c49-5289-4aad-88ff-23686a446feb service glance] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:38.380586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1028/2057] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:38.828817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a1d7-cfe4-40b4-be9d-ea151323cf11 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:38.831238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3ea5a1d7-cfe4-40b4-be9d-ea151323cf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:38.962417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a1d7-cfe4-40b4-be9d-ea151323cf11 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:38.968141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:38.969223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:38.969730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:38.970156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] PATH_INFO: `/v3/users/f79f0658f5454b04bdbe7192221325ca` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:38.971644 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79f0658f5454b04bdbe7192221325ca)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:38.974140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:39.069996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79f0658f5454b04bdbe7192221325ca'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.074042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79f0658f5454b04bdbe7192221325ca'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.111985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:39.126586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79f0658f5454b04bdbe7192221325ca'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.151783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79f0658f5454b04bdbe7192221325ca'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.152822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-53b5ca48-67e6-4067-b6dc-51467b3d1183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79f0658f5454b04bdbe7192221325ca'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.183146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1030/2058] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:38 2022] DELETE /identity/v3/users/f79f0658f5454b04bdbe7192221325ca => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:39.187609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9e754-f749-4b7a-a1ba-508015eb5cb7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:39.188505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9e754-f749-4b7a-a1ba-508015eb5cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:39.188962 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9e754-f749-4b7a-a1ba-508015eb5cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:39.218366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-17c9e754-f749-4b7a-a1ba-508015eb5cb7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:39.226340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-17c9e754-f749-4b7a-a1ba-508015eb5cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:39.283174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683eefa-97b4-43a5-b452-541fb121d12f None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:39.283477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683eefa-97b4-43a5-b452-541fb121d12f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:39.283754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683eefa-97b4-43a5-b452-541fb121d12f None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:39.285749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1031/2059] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:48:39.291641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24223f4-ecb2-425e-9bd7-daef1545c50d None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:39.292176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24223f4-ecb2-425e-9bd7-daef1545c50d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:39.292628 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24223f4-ecb2-425e-9bd7-daef1545c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:39.317452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b24223f4-ecb2-425e-9bd7-daef1545c50d None None] MFA Rules not processed for user `be696635db224e3a868957eb5b5bae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:39.318363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b24223f4-ecb2-425e-9bd7-daef1545c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:39.319149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1029/2060] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:39.335295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9e754-f749-4b7a-a1ba-508015eb5cb7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:39.338400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-17c9e754-f749-4b7a-a1ba-508015eb5cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:39.459041 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9e754-f749-4b7a-a1ba-508015eb5cb7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:39.464654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129b03-b46a-4018-9ba0-903e0d17a1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:39.465472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129b03-b46a-4018-9ba0-903e0d17a1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:39.465860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129b03-b46a-4018-9ba0-903e0d17a1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:39.466242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129b03-b46a-4018-9ba0-903e0d17a1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:39.472293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1032/2061] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:48:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:39.473348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24223f4-ecb2-425e-9bd7-daef1545c50d None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:39.474702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b24223f4-ecb2-425e-9bd7-daef1545c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:39.486944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97129b03-b46a-4018-9ba0-903e0d17a1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:39.486944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97129b03-b46a-4018-9ba0-903e0d17a1e9 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:39.498266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1030/2062] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:39.499001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24223f4-ecb2-425e-9bd7-daef1545c50d None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:39.499193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129b03-b46a-4018-9ba0-903e0d17a1e9 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:39.500656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-97129b03-b46a-4018-9ba0-903e0d17a1e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:39.504650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:39.505573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:39.505959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:39.506324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] PATH_INFO: `/v3/users/f3d50a4d32b0479da61ccd26ff894197` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:39.507845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d50a4d32b0479da61ccd26ff894197)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:39.510550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:39.519128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129b03-b46a-4018-9ba0-903e0d17a1e9 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:39.528580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07865e71-8366-488e-83be-676aa07a9fe1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:39.529620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07865e71-8366-488e-83be-676aa07a9fe1 service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:39.529970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07865e71-8366-488e-83be-676aa07a9fe1 service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:39.530320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07865e71-8366-488e-83be-676aa07a9fe1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:39.552729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07865e71-8366-488e-83be-676aa07a9fe1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:39.560482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07865e71-8366-488e-83be-676aa07a9fe1 service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:39.605608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1031/2063] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:39.613525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d50a4d32b0479da61ccd26ff894197'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.614279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d50a4d32b0479da61ccd26ff894197'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.642881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d50a4d32b0479da61ccd26ff894197'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.656091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d50a4d32b0479da61ccd26ff894197'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.656903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d50a4d32b0479da61ccd26ff894197'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:39.678046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1033/2064] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:39 2022] DELETE /identity/v3/users/f3d50a4d32b0479da61ccd26ff894197 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:39.871576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07865e71-8366-488e-83be-676aa07a9fe1 service placement] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:39.873292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-07865e71-8366-488e-83be-676aa07a9fe1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:39.880616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:39.881400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:39.919624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07865e71-8366-488e-83be-676aa07a9fe1 service placement] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:39.942741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:39.967534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b300bc0-3d7a-47fd-81c2-98d4be387b65 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:39.972681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:39.973347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:39.973627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:39.973929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] PATH_INFO: `/v3/projects/afe9b93cc4be499d8c794274ff38f65c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:39.975099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe9b93cc4be499d8c794274ff38f65c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:39.977071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:39.987443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:39.988077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:39.988356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:39.988658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] PATH_INFO: `/v3/projects/99db8674d79b46a49f1743bc5b21581e` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:39.989777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99db8674d79b46a49f1743bc5b21581e)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:39.994758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:40.024908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:40.035731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe9b93cc4be499d8c794274ff38f65c', 'request_id': 'req-0bc295e0-8ee0-418b-88bb-ed138364f4ce'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.043223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe9b93cc4be499d8c794274ff38f65c', 'request_id': 'req-0bc295e0-8ee0-418b-88bb-ed138364f4ce'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.050076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99db8674d79b46a49f1743bc5b21581e', 'request_id': 'req-e4804002-49d4-491d-a43b-bd37a033d5f9'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.051322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe9b93cc4be499d8c794274ff38f65c', 'request_id': 'req-0bc295e0-8ee0-418b-88bb-ed138364f4ce'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.057529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99db8674d79b46a49f1743bc5b21581e', 'request_id': 'req-e4804002-49d4-491d-a43b-bd37a033d5f9'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.063437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] The token cache is being invalidate because project afe9b93cc4be499d8c794274ff38f65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:40.063727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.064374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0bc295e0-8ee0-418b-88bb-ed138364f4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.065226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99db8674d79b46a49f1743bc5b21581e', 'request_id': 'req-e4804002-49d4-491d-a43b-bd37a033d5f9'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.065955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1034/2065] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:39 2022] DELETE /identity/v3/projects/afe9b93cc4be499d8c794274ff38f65c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:40.072219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aab7f-9ee8-471f-ab9e-7a8e28f420c6 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.072940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aab7f-9ee8-471f-ab9e-7a8e28f420c6 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.072940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aab7f-9ee8-471f-ab9e-7a8e28f420c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.078441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] The token cache is being invalidate because project 99db8674d79b46a49f1743bc5b21581e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:40.078828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.079640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.081230 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1032/2066] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:39 2022] DELETE /identity/v3/projects/99db8674d79b46a49f1743bc5b21581e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:40.085176 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:40.087487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:40.094310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a21aab7f-9ee8-471f-ab9e-7a8e28f420c6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:40.099328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a21aab7f-9ee8-471f-ab9e-7a8e28f420c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:40.172154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4804002-49d4-491d-a43b-bd37a033d5f9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:40.173422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1035/2067] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:40.176740 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:40.177368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.177644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.177916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] PATH_INFO: `/v3/users/4689b5b5609740b88c3cc4719cb8afc4` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.179071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=4689b5b5609740b88c3cc4719cb8afc4)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:40.182236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:40.184562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce058ee-a7f1-4e59-9b96-6a9bcca8029a None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.185318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce058ee-a7f1-4e59-9b96-6a9bcca8029a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.185636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce058ee-a7f1-4e59-9b96-6a9bcca8029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.212899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8ce058ee-a7f1-4e59-9b96-6a9bcca8029a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:40.212899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8ce058ee-a7f1-4e59-9b96-6a9bcca8029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:40.222709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1036/2068] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:40.227689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce058ee-a7f1-4e59-9b96-6a9bcca8029a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:40.238991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce058ee-a7f1-4e59-9b96-6a9bcca8029a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:40.245700 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926c71-4b33-42a5-8cf8-85e4ac10cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:40.246308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926c71-4b33-42a5-8cf8-85e4ac10cc57 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.246587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926c71-4b33-42a5-8cf8-85e4ac10cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.246966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926c71-4b33-42a5-8cf8-85e4ac10cc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.247621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926c71-4b33-42a5-8cf8-85e4ac10cc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:40.247933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926c71-4b33-42a5-8cf8-85e4ac10cc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:40.249533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926c71-4b33-42a5-8cf8-85e4ac10cc57 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:40.252416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4689b5b5609740b88c3cc4719cb8afc4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.261361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4689b5b5609740b88c3cc4719cb8afc4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.263195 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1037/2069] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:48:40.267964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926c71-4b33-42a5-8cf8-85e4ac10cc57 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:40.269846 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4689b5b5609740b88c3cc4719cb8afc4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.282121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926c71-4b33-42a5-8cf8-85e4ac10cc57 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:40.288620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2c9ca-0beb-4021-abb8-8539fbef3beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:40.288620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c9ca-0beb-4021-abb8-8539fbef3beb admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.288620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c9ca-0beb-4021-abb8-8539fbef3beb admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.288620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c9ca-0beb-4021-abb8-8539fbef3beb admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.289291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2c9ca-0beb-4021-abb8-8539fbef3beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:40.292112 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2c9ca-0beb-4021-abb8-8539fbef3beb admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:40.299903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4689b5b5609740b88c3cc4719cb8afc4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.300657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4689b5b5609740b88c3cc4719cb8afc4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:40.309167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1033/2070] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:40 2022] DELETE /identity/v3/users/4689b5b5609740b88c3cc4719cb8afc4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:40.334564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1038/2071] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:40 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:40.339068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:40.340577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:40.385901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:40.455878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdf326-9cee-4a45-bf18-8c4825f55bda admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:40.539208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102f2fa-31df-46c8-a912-9e0d143c48cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:40.540946 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102f2fa-31df-46c8-a912-9e0d143c48cb admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.541265 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102f2fa-31df-46c8-a912-9e0d143c48cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.541492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102f2fa-31df-46c8-a912-9e0d143c48cb admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.542134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102f2fa-31df-46c8-a912-9e0d143c48cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:40.544137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102f2fa-31df-46c8-a912-9e0d143c48cb admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:40.574044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1034/2072] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:40 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:40.578305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2c9ca-0beb-4021-abb8-8539fbef3beb admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:40.593900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2c9ca-0beb-4021-abb8-8539fbef3beb admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:40.597616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723dc9d-30d2-4058-98a2-490bc8ff5d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:40.598328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723dc9d-30d2-4058-98a2-490bc8ff5d5e admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.598614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723dc9d-30d2-4058-98a2-490bc8ff5d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.598913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723dc9d-30d2-4058-98a2-490bc8ff5d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.599825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723dc9d-30d2-4058-98a2-490bc8ff5d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:40.601471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723dc9d-30d2-4058-98a2-490bc8ff5d5e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:40.614818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1039/2073] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:40.618701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102f2fa-31df-46c8-a912-9e0d143c48cb admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:40.630888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102f2fa-31df-46c8-a912-9e0d143c48cb admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:40.636839 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cbe25-542e-4446-b783-7c115c222a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:40.637461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cbe25-542e-4446-b783-7c115c222a8a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.637787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cbe25-542e-4446-b783-7c115c222a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.638114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cbe25-542e-4446-b783-7c115c222a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.640418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cbe25-542e-4446-b783-7c115c222a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:40.640563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cbe25-542e-4446-b783-7c115c222a8a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:40.652551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1035/2074] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:40.656815 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723dc9d-30d2-4058-98a2-490bc8ff5d5e admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:40.669608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723dc9d-30d2-4058-98a2-490bc8ff5d5e admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:40.673835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cc159-e5be-4f5c-8ee4-5f2b6a3a05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:40.674569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc159-e5be-4f5c-8ee4-5f2b6a3a05a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.674885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc159-e5be-4f5c-8ee4-5f2b6a3a05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.675201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc159-e5be-4f5c-8ee4-5f2b6a3a05a5 admin admin] PATH_INFO: `/v3/projects/214ad6d03907498aa57074b0a51b93b0/users/40c7c0ae1660404b8ec1e3eae0eb92e5/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.692576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc159-e5be-4f5c-8ee4-5f2b6a3a05a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214ad6d03907498aa57074b0a51b93b0, user_id=40c7c0ae1660404b8ec1e3eae0eb92e5, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:40.695620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc159-e5be-4f5c-8ee4-5f2b6a3a05a5 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:40.699836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:40.734873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706b11-3b6a-4734-b050-fbe9520ad41a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.735212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706b11-3b6a-4734-b050-fbe9520ad41a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.735429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706b11-3b6a-4734-b050-fbe9520ad41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:40.738103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1040/2075] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:40 2022] PUT /identity/v3/projects/214ad6d03907498aa57074b0a51b93b0/users/40c7c0ae1660404b8ec1e3eae0eb92e5/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:40.764611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7d706b11-3b6a-4734-b050-fbe9520ad41a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:40.765942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7d706b11-3b6a-4734-b050-fbe9520ad41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:40.861415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1036/2076] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:40.887139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cc159-e5be-4f5c-8ee4-5f2b6a3a05a5 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:40.895391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f34cc159-e5be-4f5c-8ee4-5f2b6a3a05a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:40.986077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cc159-e5be-4f5c-8ee4-5f2b6a3a05a5 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:40.992871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a82892-49d2-4cb0-9e5d-545dd9ddd7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:40.993523 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a82892-49d2-4cb0-9e5d-545dd9ddd7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:40.993766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a82892-49d2-4cb0-9e5d-545dd9ddd7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:40.994036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a82892-49d2-4cb0-9e5d-545dd9ddd7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:41.001903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706b11-3b6a-4734-b050-fbe9520ad41a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:41.003740 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7d706b11-3b6a-4734-b050-fbe9520ad41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:41.010396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a82892-49d2-4cb0-9e5d-545dd9ddd7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:41.012279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a82892-49d2-4cb0-9e5d-545dd9ddd7c6 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:41.028655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706b11-3b6a-4734-b050-fbe9520ad41a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:41.032313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1041/2077] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:41.042506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:41.043572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:41.043916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:41.044250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] PATH_INFO: `/v3/projects/385beb9bb9d14a54acfbbb446f050985` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:41.045494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=385beb9bb9d14a54acfbbb446f050985)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:41.047519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:41.102606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385beb9bb9d14a54acfbbb446f050985', 'request_id': 'req-2efa2e9b-65da-4457-8003-f9d67aff78dd'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.105056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:41.110615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385beb9bb9d14a54acfbbb446f050985', 'request_id': 'req-2efa2e9b-65da-4457-8003-f9d67aff78dd'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.121554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385beb9bb9d14a54acfbbb446f050985', 'request_id': 'req-2efa2e9b-65da-4457-8003-f9d67aff78dd'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.140367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] The token cache is being invalidate because project 385beb9bb9d14a54acfbbb446f050985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:41.140763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.141700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.143726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1037/2078] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:41 2022] DELETE /identity/v3/projects/385beb9bb9d14a54acfbbb446f050985 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:41.149010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a82892-49d2-4cb0-9e5d-545dd9ddd7c6 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:41.184055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a82892-49d2-4cb0-9e5d-545dd9ddd7c6 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:41.276216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:41.276910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:41.277142 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:41.277463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] PATH_INFO: `/v3/users/4d7ebf1b23fc479eb0be43cad23dd55a` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:41.279333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7ebf1b23fc479eb0be43cad23dd55a)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:41.283298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:41.371478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7ebf1b23fc479eb0be43cad23dd55a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.372513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7ebf1b23fc479eb0be43cad23dd55a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.390489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7ebf1b23fc479eb0be43cad23dd55a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.404305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7ebf1b23fc479eb0be43cad23dd55a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.405439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cb3b1496-7d30-43c2-a9a1-ea8c9ee9b733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7ebf1b23fc479eb0be43cad23dd55a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.421356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1042/2079] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:41 2022] DELETE /identity/v3/users/4d7ebf1b23fc479eb0be43cad23dd55a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:41.749503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:41.751024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:41.766266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa2e9b-65da-4457-8003-f9d67aff78dd admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:41.857902 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:41.858569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:41.858948 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:41.859231 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] PATH_INFO: `/v3/projects/dd28e49114bb4cc2947f9c48f741abc5` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:41.860464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd28e49114bb4cc2947f9c48f741abc5)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:41.863674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:41.968449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd28e49114bb4cc2947f9c48f741abc5', 'request_id': 'req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.978078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd28e49114bb4cc2947f9c48f741abc5', 'request_id': 'req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:41.987886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd28e49114bb4cc2947f9c48f741abc5', 'request_id': 'req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:42.005280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] The token cache is being invalidate because project dd28e49114bb4cc2947f9c48f741abc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:42.005668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:42.006530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6c07d345-2eb9-4c24-99c4-c1e6ddcb40ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:42.009531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1038/2080] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:41 2022] DELETE /identity/v3/projects/dd28e49114bb4cc2947f9c48f741abc5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:42.013555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc183ec-c7c3-4f39-b02c-528a5ce336a2 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:42.013847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc183ec-c7c3-4f39-b02c-528a5ce336a2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:42.014119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc183ec-c7c3-4f39-b02c-528a5ce336a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:42.050984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ffc183ec-c7c3-4f39-b02c-528a5ce336a2 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:42.052637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ffc183ec-c7c3-4f39-b02c-528a5ce336a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:42.068863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:42.170836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1043/2081] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:42.179808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a337944-fc62-4c04-96aa-82c0dea4f400 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:42.180991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a337944-fc62-4c04-96aa-82c0dea4f400 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:42.181483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a337944-fc62-4c04-96aa-82c0dea4f400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:42.223876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3a337944-fc62-4c04-96aa-82c0dea4f400 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:42.225100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3a337944-fc62-4c04-96aa-82c0dea4f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:42.253146 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1039/2082] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:42.254234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc183ec-c7c3-4f39-b02c-528a5ce336a2 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:42.271335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc183ec-c7c3-4f39-b02c-528a5ce336a2 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:42.285294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bf7ad-3e23-425d-a50d-5465d73e6e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:42.286129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bf7ad-3e23-425d-a50d-5465d73e6e09 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:42.290753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bf7ad-3e23-425d-a50d-5465d73e6e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:42.291104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bf7ad-3e23-425d-a50d-5465d73e6e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:42.291807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bf7ad-3e23-425d-a50d-5465d73e6e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:42.292637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bf7ad-3e23-425d-a50d-5465d73e6e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:42.297621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bf7ad-3e23-425d-a50d-5465d73e6e09 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:42.332082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1044/2083] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:42.346167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a337944-fc62-4c04-96aa-82c0dea4f400 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:42.353127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a337944-fc62-4c04-96aa-82c0dea4f400 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:42.363012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c63b11-9d53-49a8-a281-383e70da2106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:42.363640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c63b11-9d53-49a8-a281-383e70da2106 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:42.363913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c63b11-9d53-49a8-a281-383e70da2106 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:42.364199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c63b11-9d53-49a8-a281-383e70da2106 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:42.364808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c63b11-9d53-49a8-a281-383e70da2106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:42.366760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c63b11-9d53-49a8-a281-383e70da2106 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:42.427096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1040/2084] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:42 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:42.428835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bf7ad-3e23-425d-a50d-5465d73e6e09 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:42.449263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bf7ad-3e23-425d-a50d-5465d73e6e09 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:42.528361 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff4af5-c646-43ba-b93c-1e9d59aa3343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:42.529492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff4af5-c646-43ba-b93c-1e9d59aa3343 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:42.529920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff4af5-c646-43ba-b93c-1e9d59aa3343 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:42.530370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff4af5-c646-43ba-b93c-1e9d59aa3343 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:42.531549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff4af5-c646-43ba-b93c-1e9d59aa3343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:42.534749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff4af5-c646-43ba-b93c-1e9d59aa3343 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:42.588250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1045/2085] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:42 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:42.589313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c63b11-9d53-49a8-a281-383e70da2106 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:42.612062 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c63b11-9d53-49a8-a281-383e70da2106 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:42.628323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6184b-966e-49e0-9130-96e1636d09a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:42.629389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6184b-966e-49e0-9130-96e1636d09a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:42.629792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6184b-966e-49e0-9130-96e1636d09a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:42.630198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6184b-966e-49e0-9130-96e1636d09a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:42.631591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6184b-966e-49e0-9130-96e1636d09a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:42.635564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6184b-966e-49e0-9130-96e1636d09a0 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:42.656821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1041/2086] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:42.661901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff4af5-c646-43ba-b93c-1e9d59aa3343 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:42.677507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff4af5-c646-43ba-b93c-1e9d59aa3343 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:42.686068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a778733-4c86-439c-8c39-b56cb0d5646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:42.687698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a778733-4c86-439c-8c39-b56cb0d5646b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:42.688688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a778733-4c86-439c-8c39-b56cb0d5646b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:42.689029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a778733-4c86-439c-8c39-b56cb0d5646b admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:42.689719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a778733-4c86-439c-8c39-b56cb0d5646b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:42.693628 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a778733-4c86-439c-8c39-b56cb0d5646b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:42.734254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1046/2087] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:42.737823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6184b-966e-49e0-9130-96e1636d09a0 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:42.750026 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6184b-966e-49e0-9130-96e1636d09a0 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:42.755801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca406d-a5ce-433b-ba3b-bb020318029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:42.756355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca406d-a5ce-433b-ba3b-bb020318029f admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:42.756711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca406d-a5ce-433b-ba3b-bb020318029f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:42.756899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca406d-a5ce-433b-ba3b-bb020318029f admin admin] PATH_INFO: `/v3/projects/10381163e1974af898294db9e8005276/users/f31e9e73270d492b89c87a4fd3158b79/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:42.778164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca406d-a5ce-433b-ba3b-bb020318029f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10381163e1974af898294db9e8005276, user_id=f31e9e73270d492b89c87a4fd3158b79, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:42.783748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca406d-a5ce-433b-ba3b-bb020318029f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:42.802730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1042/2088] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:42 2022] PUT /identity/v3/projects/10381163e1974af898294db9e8005276/users/f31e9e73270d492b89c87a4fd3158b79/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:42.814131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96517465-1360-42f6-a549-f85d6a0448e2 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:42.814429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96517465-1360-42f6-a549-f85d6a0448e2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:42.815048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96517465-1360-42f6-a549-f85d6a0448e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:42.854413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-96517465-1360-42f6-a549-f85d6a0448e2 None None] MFA Rules not processed for user `f31e9e73270d492b89c87a4fd3158b79`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:42.856021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-96517465-1360-42f6-a549-f85d6a0448e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:42.950067 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1047/2089] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:42.956318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca406d-a5ce-433b-ba3b-bb020318029f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:42.970869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:43.052734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca406d-a5ce-433b-ba3b-bb020318029f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:43.072763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d201a-2abc-420a-b6c0-006be3912e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:43.073574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d201a-2abc-420a-b6c0-006be3912e4e admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:43.073857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d201a-2abc-420a-b6c0-006be3912e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:43.074129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d201a-2abc-420a-b6c0-006be3912e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:43.074784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d201a-2abc-420a-b6c0-006be3912e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:43.076733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d201a-2abc-420a-b6c0-006be3912e4e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:43.114869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1043/2090] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:42 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:43.122208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96517465-1360-42f6-a549-f85d6a0448e2 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:43.136808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96517465-1360-42f6-a549-f85d6a0448e2 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:43.147186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:43.206360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3b9d-ea16-4d4f-a587-252248f6767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:43.207159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3b9d-ea16-4d4f-a587-252248f6767d admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:43.207259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3b9d-ea16-4d4f-a587-252248f6767d admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:43.207449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3b9d-ea16-4d4f-a587-252248f6767d admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:43.208087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e3b9d-ea16-4d4f-a587-252248f6767d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:43.210027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e3b9d-ea16-4d4f-a587-252248f6767d admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:43.240055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1048/2091] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:43 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:43.241594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d201a-2abc-420a-b6c0-006be3912e4e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:43.254738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d201a-2abc-420a-b6c0-006be3912e4e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:43.260898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6593c-dedd-487e-af5c-7f0744f48714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:43.261538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6593c-dedd-487e-af5c-7f0744f48714 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:43.262025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6593c-dedd-487e-af5c-7f0744f48714 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:43.262160 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6593c-dedd-487e-af5c-7f0744f48714 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:43.262949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6593c-dedd-487e-af5c-7f0744f48714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:43.264667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6593c-dedd-487e-af5c-7f0744f48714 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:43.284152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1044/2092] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:43.285451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3b9d-ea16-4d4f-a587-252248f6767d admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:43.297940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3b9d-ea16-4d4f-a587-252248f6767d admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:43.304035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ddc11-eaff-4778-a59d-477ab72602e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:43.304663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ddc11-eaff-4778-a59d-477ab72602e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:43.305620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ddc11-eaff-4778-a59d-477ab72602e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:43.305908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ddc11-eaff-4778-a59d-477ab72602e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:43.306744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ddc11-eaff-4778-a59d-477ab72602e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:43.308484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ddc11-eaff-4778-a59d-477ab72602e4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:43.322610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1049/2093] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:43.331829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6593c-dedd-487e-af5c-7f0744f48714 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:43.349114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6593c-dedd-487e-af5c-7f0744f48714 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:43.368550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf59f-9a91-4e1c-b39d-53362ad51373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:43.369519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf59f-9a91-4e1c-b39d-53362ad51373 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:43.369874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf59f-9a91-4e1c-b39d-53362ad51373 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:43.370147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf59f-9a91-4e1c-b39d-53362ad51373 admin admin] PATH_INFO: `/v3/projects/70c58447eff34aa687ae0466d686e938/users/f6b498808fd84e969466e40508d73c20/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:43.416515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf59f-9a91-4e1c-b39d-53362ad51373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c58447eff34aa687ae0466d686e938, user_id=f6b498808fd84e969466e40508d73c20, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:43.419754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf59f-9a91-4e1c-b39d-53362ad51373 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:43.440754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1045/2094] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:43 2022] PUT /identity/v3/projects/70c58447eff34aa687ae0466d686e938/users/f6b498808fd84e969466e40508d73c20/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:43.452422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4972fb0-c559-4061-9918-7222b442101a None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:43.452716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4972fb0-c559-4061-9918-7222b442101a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:43.452980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4972fb0-c559-4061-9918-7222b442101a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:43.495598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f4972fb0-c559-4061-9918-7222b442101a None None] MFA Rules not processed for user `f6b498808fd84e969466e40508d73c20`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:43.499140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f4972fb0-c559-4061-9918-7222b442101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:43.623284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1050/2095] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:43.632823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf59f-9a91-4e1c-b39d-53362ad51373 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:43.833912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf59f-9a91-4e1c-b39d-53362ad51373 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:43.848165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ee0aa-e924-482a-a699-4a29aa56321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:43.848799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ee0aa-e924-482a-a699-4a29aa56321e admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:43.851009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ee0aa-e924-482a-a699-4a29aa56321e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:43.852857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ee0aa-e924-482a-a699-4a29aa56321e admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:43.853828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ee0aa-e924-482a-a699-4a29aa56321e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:43.856017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ee0aa-e924-482a-a699-4a29aa56321e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:43.928625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1046/2096] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:43 2022] POST /identity/v3/projects => generated 385 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:43.933133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4972fb0-c559-4061-9918-7222b442101a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:43.952441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4972fb0-c559-4061-9918-7222b442101a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:44.048284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b1071-742b-49d2-ae50-e33753203212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:44.051859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b1071-742b-49d2-ae50-e33753203212 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:44.051859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b1071-742b-49d2-ae50-e33753203212 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:44.051859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b1071-742b-49d2-ae50-e33753203212 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:44.051859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b1071-742b-49d2-ae50-e33753203212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:44.052805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b1071-742b-49d2-ae50-e33753203212 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:44.095785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ee0aa-e924-482a-a699-4a29aa56321e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:44.098330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-713ee0aa-e924-482a-a699-4a29aa56321e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:44.115550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1051/2097] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:43 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:44.116492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b1071-742b-49d2-ae50-e33753203212 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:44.121969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ee0aa-e924-482a-a699-4a29aa56321e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:44.131490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:44.132190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:44.132714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:44.133217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] PATH_INFO: `/v3/users/68e1992870de447fa8382881d06c0f84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:44.135163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e1992870de447fa8382881d06c0f84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:44.136995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b1071-742b-49d2-ae50-e33753203212 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:44.137193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:44.149337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ce35-086f-4f54-a70f-f452feea3cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:44.151146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ce35-086f-4f54-a70f-f452feea3cea admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:44.151507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ce35-086f-4f54-a70f-f452feea3cea admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:44.152812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ce35-086f-4f54-a70f-f452feea3cea admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:44.153879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2ce35-086f-4f54-a70f-f452feea3cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:44.156209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2ce35-086f-4f54-a70f-f452feea3cea admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:44.188537 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:44.202979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1052/2098] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:44.204382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ce35-086f-4f54-a70f-f452feea3cea admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:44.217034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ce35-086f-4f54-a70f-f452feea3cea admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:44.222268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9395b-5153-4b75-8cf5-dbb1895d97cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:44.223004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9395b-5153-4b75-8cf5-dbb1895d97cb admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:44.223675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9395b-5153-4b75-8cf5-dbb1895d97cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:44.224173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9395b-5153-4b75-8cf5-dbb1895d97cb admin admin] PATH_INFO: `/v3/projects/566e172ffec94c68b67ab632c705c9a6/users/45d0030c9f924bdc94b693a3dde97e25/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:44.231622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:44.261395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9395b-5153-4b75-8cf5-dbb1895d97cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=566e172ffec94c68b67ab632c705c9a6, user_id=45d0030c9f924bdc94b693a3dde97e25, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:44.264311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9395b-5153-4b75-8cf5-dbb1895d97cb admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:44.278414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e1992870de447fa8382881d06c0f84'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:44.287727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e1992870de447fa8382881d06c0f84'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:44.295354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1053/2099] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:44 2022] PUT /identity/v3/projects/566e172ffec94c68b67ab632c705c9a6/users/45d0030c9f924bdc94b693a3dde97e25/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:44.296374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9395b-5153-4b75-8cf5-dbb1895d97cb admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:44.304235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e1992870de447fa8382881d06c0f84'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:44.334952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e1992870de447fa8382881d06c0f84'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:44.336050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-968decb3-89ef-4170-936c-8414a9941e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e1992870de447fa8382881d06c0f84'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:44.350472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1047/2100] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:44 2022] DELETE /identity/v3/users/68e1992870de447fa8382881d06c0f84 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:44.355726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206e894-a1a1-443f-9f05-3b45e981c9b5 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:44.356210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206e894-a1a1-443f-9f05-3b45e981c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:44.356501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206e894-a1a1-443f-9f05-3b45e981c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:44.384472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9206e894-a1a1-443f-9f05-3b45e981c9b5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:44.387693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9206e894-a1a1-443f-9f05-3b45e981c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:44.499354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1048/2101] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:44.514223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206e894-a1a1-443f-9f05-3b45e981c9b5 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:44.529079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9206e894-a1a1-443f-9f05-3b45e981c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:44.563639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9395b-5153-4b75-8cf5-dbb1895d97cb admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:44.589728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11e9c1-bf74-43d1-9f2b-33f56baf3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:44.593893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11e9c1-bf74-43d1-9f2b-33f56baf3859 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:44.594235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11e9c1-bf74-43d1-9f2b-33f56baf3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:44.594522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11e9c1-bf74-43d1-9f2b-33f56baf3859 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:44.599506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11e9c1-bf74-43d1-9f2b-33f56baf3859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:44.610709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11e9c1-bf74-43d1-9f2b-33f56baf3859 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:44.657970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1054/2102] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:44.664229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11e9c1-bf74-43d1-9f2b-33f56baf3859 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:44.675235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1c11e9c1-bf74-43d1-9f2b-33f56baf3859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:44.712602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206e894-a1a1-443f-9f05-3b45e981c9b5 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:44.723394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11e9c1-bf74-43d1-9f2b-33f56baf3859 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:44.723577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce72f9-f756-4409-b36a-33d0b41d2767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:44.724157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce72f9-f756-4409-b36a-33d0b41d2767 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:44.724447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce72f9-f756-4409-b36a-33d0b41d2767 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:44.724718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce72f9-f756-4409-b36a-33d0b41d2767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:44.737624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0268d-a41a-403a-b45f-11ac80d74a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:44.738152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0268d-a41a-403a-b45f-11ac80d74a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:44.738434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0268d-a41a-403a-b45f-11ac80d74a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:44.738709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0268d-a41a-403a-b45f-11ac80d74a42 admin admin] PATH_INFO: `/v3/projects/566e172ffec94c68b67ab632c705c9a6/users/45d0030c9f924bdc94b693a3dde97e25/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:44.745043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0268d-a41a-403a-b45f-11ac80d74a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566e172ffec94c68b67ab632c705c9a6, user_id=45d0030c9f924bdc94b693a3dde97e25, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:44.749918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce72f9-f756-4409-b36a-33d0b41d2767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:44.762435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce72f9-f756-4409-b36a-33d0b41d2767 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:44.769113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0268d-a41a-403a-b45f-11ac80d74a42 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:44.796397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1055/2104] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:44 2022] PUT /identity/v3/projects/566e172ffec94c68b67ab632c705c9a6/users/45d0030c9f924bdc94b693a3dde97e25/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:44.802865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1049/2104] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:44.820446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b310b8-7204-4ab1-a9e3-74eb0dec95c8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:44.821414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b310b8-7204-4ab1-a9e3-74eb0dec95c8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:44.821792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b310b8-7204-4ab1-a9e3-74eb0dec95c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:44.879096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-93b310b8-7204-4ab1-a9e3-74eb0dec95c8 None None] MFA Rules not processed for user `45d0030c9f924bdc94b693a3dde97e25`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:44.882758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-93b310b8-7204-4ab1-a9e3-74eb0dec95c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:45.005965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1056/2105] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:45.018614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce72f9-f756-4409-b36a-33d0b41d2767 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:45.021156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1dce72f9-f756-4409-b36a-33d0b41d2767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:45.111442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce72f9-f756-4409-b36a-33d0b41d2767 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:45.126556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:45.229617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459b08-da09-4ca9-a8a2-9b2fa112c29c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:45.230628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459b08-da09-4ca9-a8a2-9b2fa112c29c service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:45.231592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459b08-da09-4ca9-a8a2-9b2fa112c29c service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:45.232075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459b08-da09-4ca9-a8a2-9b2fa112c29c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:45.235246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ba459b08-da09-4ca9-a8a2-9b2fa112c29c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:45.351832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459b08-da09-4ca9-a8a2-9b2fa112c29c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:45.354148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459b08-da09-4ca9-a8a2-9b2fa112c29c service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:45.365187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1050/2106] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:45.379778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b310b8-7204-4ab1-a9e3-74eb0dec95c8 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:45.382313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-93b310b8-7204-4ab1-a9e3-74eb0dec95c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:45.449049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:45.489781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b310b8-7204-4ab1-a9e3-74eb0dec95c8 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:45.496394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:45.497222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:45.497643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:45.498336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] PATH_INFO: `/v3/projects/520b60238573499f9b94c64bfcf65184` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:45.501236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520b60238573499f9b94c64bfcf65184)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:45.504851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:45.620041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520b60238573499f9b94c64bfcf65184', 'request_id': 'req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:45.631873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520b60238573499f9b94c64bfcf65184', 'request_id': 'req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:45.662261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520b60238573499f9b94c64bfcf65184', 'request_id': 'req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:45.688383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] The token cache is being invalidate because project 520b60238573499f9b94c64bfcf65184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:45.688664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:45.690971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:45.708950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1057/2107] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:45 2022] DELETE /identity/v3/projects/520b60238573499f9b94c64bfcf65184 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:45.710232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459b08-da09-4ca9-a8a2-9b2fa112c29c service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:45.731046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459b08-da09-4ca9-a8a2-9b2fa112c29c service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:45.868930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:45.869937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:45.870399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:45.870876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] PATH_INFO: `/v3/users/5afa81e46ab14fd8ae3275c0b29e06f6` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:45.872958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afa81e46ab14fd8ae3275c0b29e06f6)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:45.875492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:46.001783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afa81e46ab14fd8ae3275c0b29e06f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.022205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afa81e46ab14fd8ae3275c0b29e06f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.041485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afa81e46ab14fd8ae3275c0b29e06f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.051826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:46.071730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afa81e46ab14fd8ae3275c0b29e06f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.072728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afa81e46ab14fd8ae3275c0b29e06f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.082532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1051/2108] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:45 2022] DELETE /identity/v3/users/5afa81e46ab14fd8ae3275c0b29e06f6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:46.453276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:46.455285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:46.482329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d7ae3-17e7-4643-8b57-1a321a50c6d8 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:46.613091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:46.614548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:46.618859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:46.619572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:46.619855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:46.620131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] PATH_INFO: `/v3/projects/e459a60fced84c2aa9cc0410608c44c3` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:46.621456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e459a60fced84c2aa9cc0410608c44c3)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:46.623472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:46.640081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b6495-30ea-41fa-b828-d6ae38511e0b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:46.648015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:46.650130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:46.669117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:46.669633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] PATH_INFO: `/v3/users/5b40e10c987d45c48b2dc308d174476d` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:46.675750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b40e10c987d45c48b2dc308d174476d)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:46.678295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:46.720688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e459a60fced84c2aa9cc0410608c44c3', 'request_id': 'req-09efbc16-441d-4890-b8a7-6d7cf38490d2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.729146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e459a60fced84c2aa9cc0410608c44c3', 'request_id': 'req-09efbc16-441d-4890-b8a7-6d7cf38490d2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.756863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e459a60fced84c2aa9cc0410608c44c3', 'request_id': 'req-09efbc16-441d-4890-b8a7-6d7cf38490d2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.793079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] The token cache is being invalidate because project e459a60fced84c2aa9cc0410608c44c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:46.793380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.794101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-09efbc16-441d-4890-b8a7-6d7cf38490d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.797330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1058/2109] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:46 2022] DELETE /identity/v3/projects/e459a60fced84c2aa9cc0410608c44c3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:46.805376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535d275-54de-4c85-b960-ddafcacd5eee None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:46.805881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535d275-54de-4c85-b960-ddafcacd5eee None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:46.806422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535d275-54de-4c85-b960-ddafcacd5eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:46.817971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:46.835572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b40e10c987d45c48b2dc308d174476d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.851678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-2535d275-54de-4c85-b960-ddafcacd5eee None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:46.854363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2535d275-54de-4c85-b960-ddafcacd5eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:46.859646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b40e10c987d45c48b2dc308d174476d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.881348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b40e10c987d45c48b2dc308d174476d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.903361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b40e10c987d45c48b2dc308d174476d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.904107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-228acf6d-3ceb-4e2b-b6b2-d9da03eec299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b40e10c987d45c48b2dc308d174476d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:46.921387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1052/2110] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:46 2022] DELETE /identity/v3/users/5b40e10c987d45c48b2dc308d174476d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:46.925551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a0a9c-123f-44c1-9d5c-37cf5eca709c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:46.925953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a0a9c-123f-44c1-9d5c-37cf5eca709c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:46.926323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a0a9c-123f-44c1-9d5c-37cf5eca709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:46.954879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9a7a0a9c-123f-44c1-9d5c-37cf5eca709c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:46.956255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9a7a0a9c-123f-44c1-9d5c-37cf5eca709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:46.964595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1059/2111] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:46.972600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41bca9-16fa-4316-a129-62507b42a59a None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:46.973114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41bca9-16fa-4316-a129-62507b42a59a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:46.973532 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41bca9-16fa-4316-a129-62507b42a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:47.020188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-5c41bca9-16fa-4316-a129-62507b42a59a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:47.021448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5c41bca9-16fa-4316-a129-62507b42a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:47.100184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1053/2112] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:47.129873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a0a9c-123f-44c1-9d5c-37cf5eca709c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:47.137638 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9a7a0a9c-123f-44c1-9d5c-37cf5eca709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:47.188267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1060/2113] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:47.193062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8116a90-eb13-4dad-a607-949bbb019f24 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:47.193472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8116a90-eb13-4dad-a607-949bbb019f24 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:47.193824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8116a90-eb13-4dad-a607-949bbb019f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:47.233468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a8116a90-eb13-4dad-a607-949bbb019f24 None None] MFA Rules not processed for user `40c7c0ae1660404b8ec1e3eae0eb92e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:47.233746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a0a9c-123f-44c1-9d5c-37cf5eca709c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:47.235107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a8116a90-eb13-4dad-a607-949bbb019f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:47.239023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f8e24-82c4-46c6-a31f-c87cc5f207d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:47.240605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f8e24-82c4-46c6-a31f-c87cc5f207d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:47.240965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f8e24-82c4-46c6-a31f-c87cc5f207d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:47.241350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f8e24-82c4-46c6-a31f-c87cc5f207d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:47.254509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f8e24-82c4-46c6-a31f-c87cc5f207d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:47.256209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f8e24-82c4-46c6-a31f-c87cc5f207d5 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:47.280702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1054/2114] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:47.285887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f8e24-82c4-46c6-a31f-c87cc5f207d5 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:47.294089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:47.311592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f8e24-82c4-46c6-a31f-c87cc5f207d5 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:47.330434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cde3e-a507-4532-b853-686a03e89292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:47.331139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cde3e-a507-4532-b853-686a03e89292 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:47.332724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cde3e-a507-4532-b853-686a03e89292 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:47.333006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cde3e-a507-4532-b853-686a03e89292 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:47.333660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cde3e-a507-4532-b853-686a03e89292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:47.333972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cde3e-a507-4532-b853-686a03e89292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:47.335646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cde3e-a507-4532-b853-686a03e89292 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:47.371865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1061/2115] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:47.373242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8116a90-eb13-4dad-a607-949bbb019f24 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:47.375002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a8116a90-eb13-4dad-a607-949bbb019f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:47.376777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1055/2116] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:47.381849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cde3e-a507-4532-b853-686a03e89292 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:47.394320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cde3e-a507-4532-b853-686a03e89292 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:47.405200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aea3a2-c5f5-43a4-a301-5981786f3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:47.405838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aea3a2-c5f5-43a4-a301-5981786f3992 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:47.406171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aea3a2-c5f5-43a4-a301-5981786f3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:47.406456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aea3a2-c5f5-43a4-a301-5981786f3992 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:47.407301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aea3a2-c5f5-43a4-a301-5981786f3992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:47.409702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aea3a2-c5f5-43a4-a301-5981786f3992 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:47.438075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:47.457410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1056/2117] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:47 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:47.458360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aea3a2-c5f5-43a4-a301-5981786f3992 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:47.462198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-32aea3a2-c5f5-43a4-a301-5981786f3992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:47.500202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8116a90-eb13-4dad-a607-949bbb019f24 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:47.550209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aea3a2-c5f5-43a4-a301-5981786f3992 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:47.563057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea4c5b-8939-4faa-85e6-dcf2d9cb5705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:47.563848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4c5b-8939-4faa-85e6-dcf2d9cb5705 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:47.564259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4c5b-8939-4faa-85e6-dcf2d9cb5705 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:47.564596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4c5b-8939-4faa-85e6-dcf2d9cb5705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:47.569794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d8ea4c5b-8939-4faa-85e6-dcf2d9cb5705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:47.641925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98536d1-8645-42dc-8f98-d6f0e49cc705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:47.642964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98536d1-8645-42dc-8f98-d6f0e49cc705 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:47.642964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98536d1-8645-42dc-8f98-d6f0e49cc705 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:47.643180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98536d1-8645-42dc-8f98-d6f0e49cc705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:47.678585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea4c5b-8939-4faa-85e6-dcf2d9cb5705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:47.680304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea4c5b-8939-4faa-85e6-dcf2d9cb5705 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:47.697141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1057/2118] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:47.715575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98536d1-8645-42dc-8f98-d6f0e49cc705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:47.715740 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea4c5b-8939-4faa-85e6-dcf2d9cb5705 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:47.717634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98536d1-8645-42dc-8f98-d6f0e49cc705 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:47.746873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1062/2119] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:47.886202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea4c5b-8939-4faa-85e6-dcf2d9cb5705 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:47.891799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549fd39-2233-4c01-849d-d2baf74014df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:47.892430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549fd39-2233-4c01-849d-d2baf74014df admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:47.892709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549fd39-2233-4c01-849d-d2baf74014df admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:47.892981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549fd39-2233-4c01-849d-d2baf74014df admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:47.893615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549fd39-2233-4c01-849d-d2baf74014df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:47.895690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549fd39-2233-4c01-849d-d2baf74014df admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:47.910754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98536d1-8645-42dc-8f98-d6f0e49cc705 service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:47.916788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f98536d1-8645-42dc-8f98-d6f0e49cc705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:47.951298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98536d1-8645-42dc-8f98-d6f0e49cc705 service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:47.965003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1058/2120] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:47 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:47.969567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549fd39-2233-4c01-849d-d2baf74014df admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:47.976084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:47.977284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:47.977755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:47.977885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] PATH_INFO: `/v3/projects/d532b638881c4a2e8cdc2514bd24a07d` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:47.980431 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d532b638881c4a2e8cdc2514bd24a07d)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:47.982415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:47.999107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549fd39-2233-4c01-849d-d2baf74014df admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:48.019371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ad7b-f321-49cb-aa4e-3edc5f303d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:48.020442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ad7b-f321-49cb-aa4e-3edc5f303d69 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:48.020442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ad7b-f321-49cb-aa4e-3edc5f303d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:48.020646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ad7b-f321-49cb-aa4e-3edc5f303d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:48.021170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72ad7b-f321-49cb-aa4e-3edc5f303d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:48.022813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72ad7b-f321-49cb-aa4e-3edc5f303d69 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:48.036992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:48.059181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1059/2121] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:48.066176 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ad7b-f321-49cb-aa4e-3edc5f303d69 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:48.103024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ad7b-f321-49cb-aa4e-3edc5f303d69 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:48.137065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd532b638881c4a2e8cdc2514bd24a07d', 'request_id': 'req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.161476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd532b638881c4a2e8cdc2514bd24a07d', 'request_id': 'req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.172545 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd532b638881c4a2e8cdc2514bd24a07d', 'request_id': 'req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.174615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:48.206275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] The token cache is being invalidate because project d532b638881c4a2e8cdc2514bd24a07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:48.206958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.208350 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.217169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1063/2122] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:47 2022] DELETE /identity/v3/projects/d532b638881c4a2e8cdc2514bd24a07d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:48.221212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:48.225204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:48.245841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c28b8-3b0a-414e-909b-72f9ffa36609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:48.246980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c28b8-3b0a-414e-909b-72f9ffa36609 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:48.248199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c28b8-3b0a-414e-909b-72f9ffa36609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:48.248919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c28b8-3b0a-414e-909b-72f9ffa36609 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:48.249811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c28b8-3b0a-414e-909b-72f9ffa36609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:48.252057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c28b8-3b0a-414e-909b-72f9ffa36609 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:48.264148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d3a3-6782-43f9-a9bf-05a2dde80c46 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:48.267403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1060/2123] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:48.272097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c28b8-3b0a-414e-909b-72f9ffa36609 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:48.281686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-781c28b8-3b0a-414e-909b-72f9ffa36609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:48.283386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:48.284395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:48.284830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:48.285203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] PATH_INFO: `/v3/users/cbcbf8e631034d848876d2df17e563a2` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:48.287371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbcbf8e631034d848876d2df17e563a2)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:48.290397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:48.310276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c28b8-3b0a-414e-909b-72f9ffa36609 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:48.326742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a25af-a794-45de-a356-b731e6c4f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:48.327828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a25af-a794-45de-a356-b731e6c4f8de admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:48.328109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a25af-a794-45de-a356-b731e6c4f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:48.328455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a25af-a794-45de-a356-b731e6c4f8de admin admin] PATH_INFO: `/v3/projects/130e6c8d52464d7c86c92080738a0f81/users/afe254db3023480d8c93cfa118f10d48/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:48.373459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a25af-a794-45de-a356-b731e6c4f8de admin admin] RBAC: Authorizing `identity:create_grant(project_id=130e6c8d52464d7c86c92080738a0f81, user_id=afe254db3023480d8c93cfa118f10d48, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:48.377131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a25af-a794-45de-a356-b731e6c4f8de admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:48.394123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbcbf8e631034d848876d2df17e563a2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.395469 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbcbf8e631034d848876d2df17e563a2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.418799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbcbf8e631034d848876d2df17e563a2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.428299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1061/2124] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:48 2022] PUT /identity/v3/projects/130e6c8d52464d7c86c92080738a0f81/users/afe254db3023480d8c93cfa118f10d48/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:48.440989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d57eb-ad92-4c7b-a35e-e81263fdc20d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:48.441279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d57eb-ad92-4c7b-a35e-e81263fdc20d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:48.441556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d57eb-ad92-4c7b-a35e-e81263fdc20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:48.441984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbcbf8e631034d848876d2df17e563a2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.443409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbcbf8e631034d848876d2df17e563a2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:48.497982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-134d57eb-ad92-4c7b-a35e-e81263fdc20d None None] MFA Rules not processed for user `afe254db3023480d8c93cfa118f10d48`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:48.500513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1064/2125] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:48 2022] DELETE /identity/v3/users/cbcbf8e631034d848876d2df17e563a2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:48.500964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-134d57eb-ad92-4c7b-a35e-e81263fdc20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:48.713743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1062/2126] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:48.718272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:48.720117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:48.846252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c3fd0-d8b5-4808-9886-e04918584dc7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:48.853733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ccaa4-2100-486d-a3f4-4d6dd20b3dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:48.854236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ccaa4-2100-486d-a3f4-4d6dd20b3dbc admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:48.854512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ccaa4-2100-486d-a3f4-4d6dd20b3dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:48.854810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ccaa4-2100-486d-a3f4-4d6dd20b3dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:48.859216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ccaa4-2100-486d-a3f4-4d6dd20b3dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:48.866527 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ccaa4-2100-486d-a3f4-4d6dd20b3dbc admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:48.869541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d57eb-ad92-4c7b-a35e-e81263fdc20d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:48.872126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-134d57eb-ad92-4c7b-a35e-e81263fdc20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:48.977297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1065/2127] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:48 2022] POST /identity/v3/projects => generated 381 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:48.981096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ccaa4-2100-486d-a3f4-4d6dd20b3dbc admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:49.010020 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d57eb-ad92-4c7b-a35e-e81263fdc20d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:49.028080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:49.081126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a5f03-9071-4476-97d6-5c3e38897262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:49.081877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a5f03-9071-4476-97d6-5c3e38897262 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.082161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a5f03-9071-4476-97d6-5c3e38897262 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.082542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a5f03-9071-4476-97d6-5c3e38897262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.085612 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d52a5f03-9071-4476-97d6-5c3e38897262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:49.156477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:49.179324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a5f03-9071-4476-97d6-5c3e38897262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:49.181483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a5f03-9071-4476-97d6-5c3e38897262 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:49.182562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ccaa4-2100-486d-a3f4-4d6dd20b3dbc admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:49.191855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4389f6-99b7-4bbb-849f-98eaeac3e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:49.192585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4389f6-99b7-4bbb-849f-98eaeac3e500 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.192939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4389f6-99b7-4bbb-849f-98eaeac3e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.193333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4389f6-99b7-4bbb-849f-98eaeac3e500 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.194042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4389f6-99b7-4bbb-849f-98eaeac3e500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:49.196635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4389f6-99b7-4bbb-849f-98eaeac3e500 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:49.197622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1063/2128] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:49.240377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1066/2129] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:48 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:49.241726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a5f03-9071-4476-97d6-5c3e38897262 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:49.256501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a5f03-9071-4476-97d6-5c3e38897262 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:49.274634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef742143-d751-4608-b28f-847f8f7810f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:49.276792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef742143-d751-4608-b28f-847f8f7810f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.277804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef742143-d751-4608-b28f-847f8f7810f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.278587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef742143-d751-4608-b28f-847f8f7810f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.279970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef742143-d751-4608-b28f-847f8f7810f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:49.281929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef742143-d751-4608-b28f-847f8f7810f2 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:49.299798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1064/2130] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:49.301414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4389f6-99b7-4bbb-849f-98eaeac3e500 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:49.315177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4389f6-99b7-4bbb-849f-98eaeac3e500 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:49.319323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639866f-fd6e-4aca-b44b-d803157b3bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:49.321330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639866f-fd6e-4aca-b44b-d803157b3bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.321330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639866f-fd6e-4aca-b44b-d803157b3bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.321330 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639866f-fd6e-4aca-b44b-d803157b3bf1 admin admin] PATH_INFO: `/v3/projects/9ac175b7e6d746c897c114efbff27b4c/users/6a932a53221e4c8ca6d833bf8b25148c/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.356339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639866f-fd6e-4aca-b44b-d803157b3bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac175b7e6d746c897c114efbff27b4c, user_id=6a932a53221e4c8ca6d833bf8b25148c, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:49.359526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639866f-fd6e-4aca-b44b-d803157b3bf1 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:49.375390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1067/2131] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:49 2022] PUT /identity/v3/projects/9ac175b7e6d746c897c114efbff27b4c/users/6a932a53221e4c8ca6d833bf8b25148c/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:49.379741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef742143-d751-4608-b28f-847f8f7810f2 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:49.392178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef742143-d751-4608-b28f-847f8f7810f2 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:49.480665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7550e9-806a-46c0-8a99-d7ecdb879c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:49.481449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7550e9-806a-46c0-8a99-d7ecdb879c0a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.481736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7550e9-806a-46c0-8a99-d7ecdb879c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.482015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7550e9-806a-46c0-8a99-d7ecdb879c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.482678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7550e9-806a-46c0-8a99-d7ecdb879c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:49.484435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7550e9-806a-46c0-8a99-d7ecdb879c0a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:49.496761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1065/2132] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:49.501462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639866f-fd6e-4aca-b44b-d803157b3bf1 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:49.515624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639866f-fd6e-4aca-b44b-d803157b3bf1 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:49.522193 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b01a1f-b4fa-482f-ae20-53a10c76c4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:49.523032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01a1f-b4fa-482f-ae20-53a10c76c4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.523277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01a1f-b4fa-482f-ae20-53a10c76c4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.525498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01a1f-b4fa-482f-ae20-53a10c76c4d8 admin admin] PATH_INFO: `/v3/projects/9ac175b7e6d746c897c114efbff27b4c/users/6a932a53221e4c8ca6d833bf8b25148c/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.527699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b01a1f-b4fa-482f-ae20-53a10c76c4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac175b7e6d746c897c114efbff27b4c, user_id=6a932a53221e4c8ca6d833bf8b25148c, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:49.531015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b01a1f-b4fa-482f-ae20-53a10c76c4d8 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:49.546832 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1068/2133] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:49 2022] PUT /identity/v3/projects/9ac175b7e6d746c897c114efbff27b4c/users/6a932a53221e4c8ca6d833bf8b25148c/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:49.564338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7550e9-806a-46c0-8a99-d7ecdb879c0a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:49.566697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32ab01-3357-4a14-8978-11df22bbd510 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.568565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32ab01-3357-4a14-8978-11df22bbd510 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.569093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5d7550e9-806a-46c0-8a99-d7ecdb879c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:49.569832 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32ab01-3357-4a14-8978-11df22bbd510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.621358 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7550e9-806a-46c0-8a99-d7ecdb879c0a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:49.636185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8c32ab01-3357-4a14-8978-11df22bbd510 None None] MFA Rules not processed for user `6a932a53221e4c8ca6d833bf8b25148c`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:49.637613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8c32ab01-3357-4a14-8978-11df22bbd510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:49.704974 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:49.715478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1069/2134] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:49.736072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32ab01-3357-4a14-8978-11df22bbd510 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:49.745459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:49.746657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.752317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.752864 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] PATH_INFO: `/v3/projects/eb7192b1c75f431bbfb7b02c8b76c678` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.754424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7192b1c75f431bbfb7b02c8b76c678)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:49.756654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:49.830398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7192b1c75f431bbfb7b02c8b76c678', 'request_id': 'req-642083a1-3045-47fc-81e2-4e9b18aa70a4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:49.838331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7192b1c75f431bbfb7b02c8b76c678', 'request_id': 'req-642083a1-3045-47fc-81e2-4e9b18aa70a4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:49.846298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32ab01-3357-4a14-8978-11df22bbd510 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:49.850287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7192b1c75f431bbfb7b02c8b76c678', 'request_id': 'req-642083a1-3045-47fc-81e2-4e9b18aa70a4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:49.868139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] The token cache is being invalidate because project eb7192b1c75f431bbfb7b02c8b76c678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:49.868532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:49.869314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-642083a1-3045-47fc-81e2-4e9b18aa70a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:49.870914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1066/2135] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:49 2022] DELETE /identity/v3/projects/eb7192b1c75f431bbfb7b02c8b76c678 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:49.879267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d2428-3287-43fb-8c87-d80905c6fb6f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.879267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d2428-3287-43fb-8c87-d80905c6fb6f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.879267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d2428-3287-43fb-8c87-d80905c6fb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.902240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2d9d2428-3287-43fb-8c87-d80905c6fb6f None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:49.903753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2d9d2428-3287-43fb-8c87-d80905c6fb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:49.928107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:49.941485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7abd-903d-445f-9265-0070f514ccbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:49.942413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7abd-903d-445f-9265-0070f514ccbb service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.942761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7abd-903d-445f-9265-0070f514ccbb service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.943227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7abd-903d-445f-9265-0070f514ccbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:49.945813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-69ce7abd-903d-445f-9265-0070f514ccbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:49.988630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1067/2136] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:49.997461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066e81e-2bdb-4190-979b-42613f2a1e16 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:49.997751 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066e81e-2bdb-4190-979b-42613f2a1e16 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:49.998009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066e81e-2bdb-4190-979b-42613f2a1e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.026861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b066e81e-2bdb-4190-979b-42613f2a1e16 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:50.029113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b066e81e-2bdb-4190-979b-42613f2a1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:50.043488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1068/2137] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:50.047092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066e81e-2bdb-4190-979b-42613f2a1e16 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:50.063567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066e81e-2bdb-4190-979b-42613f2a1e16 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:50.074363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cfbdd-1126-4f71-b00b-c2ac90dc578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:50.074363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cfbdd-1126-4f71-b00b-c2ac90dc578b admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:50.074363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cfbdd-1126-4f71-b00b-c2ac90dc578b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:50.079057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cfbdd-1126-4f71-b00b-c2ac90dc578b admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.080003 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cfbdd-1126-4f71-b00b-c2ac90dc578b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:50.080423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cfbdd-1126-4f71-b00b-c2ac90dc578b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:50.081303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce7abd-903d-445f-9265-0070f514ccbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:50.082322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cfbdd-1126-4f71-b00b-c2ac90dc578b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:50.083137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce7abd-903d-445f-9265-0070f514ccbb service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:50.094593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1070/2138] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:48:50.107622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1069/2139] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:50.108888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cfbdd-1126-4f71-b00b-c2ac90dc578b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:50.125201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cfbdd-1126-4f71-b00b-c2ac90dc578b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:50.147240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536618d-dc6c-4360-ba70-df644d6964cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:50.148099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536618d-dc6c-4360-ba70-df644d6964cd admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:50.148374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536618d-dc6c-4360-ba70-df644d6964cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:50.148727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536618d-dc6c-4360-ba70-df644d6964cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.149392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536618d-dc6c-4360-ba70-df644d6964cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:50.152651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536618d-dc6c-4360-ba70-df644d6964cd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:50.203843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1070/2140] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:50 2022] POST /identity/v3/projects => generated 401 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:50.205237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7abd-903d-445f-9265-0070f514ccbb service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:50.208785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536618d-dc6c-4360-ba70-df644d6964cd admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:50.210955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0536618d-dc6c-4360-ba70-df644d6964cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:50.219471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7abd-903d-445f-9265-0070f514ccbb service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:50.320800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:50.343338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a9f95-dcdb-4f22-8ced-99ca6f42b275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:50.344391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a9f95-dcdb-4f22-8ced-99ca6f42b275 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:50.344937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a9f95-dcdb-4f22-8ced-99ca6f42b275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:50.345509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a9f95-dcdb-4f22-8ced-99ca6f42b275 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.346419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a9f95-dcdb-4f22-8ced-99ca6f42b275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:50.350417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a9f95-dcdb-4f22-8ced-99ca6f42b275 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:50.364830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536618d-dc6c-4360-ba70-df644d6964cd admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:50.380013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1071/2141] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:50 2022] POST /identity/v3/users => generated 301 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:50.381781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbb2e8-8653-4646-b616-c2b4681bb00b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:50.382275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbb2e8-8653-4646-b616-c2b4681bb00b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:50.383827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbb2e8-8653-4646-b616-c2b4681bb00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.385771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7b18-0725-41ab-b359-d1b14d55b2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:50.387767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7b18-0725-41ab-b359-d1b14d55b2bc service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:50.388441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7b18-0725-41ab-b359-d1b14d55b2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:50.389800 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7b18-0725-41ab-b359-d1b14d55b2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.393143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9f8e7b18-0725-41ab-b359-d1b14d55b2bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:50.416482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-18cbb2e8-8653-4646-b616-c2b4681bb00b None None] MFA Rules not processed for user `40c7c0ae1660404b8ec1e3eae0eb92e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:50.418265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-18cbb2e8-8653-4646-b616-c2b4681bb00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:50.515090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e7b18-0725-41ab-b359-d1b14d55b2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:50.517058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e7b18-0725-41ab-b359-d1b14d55b2bc service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:50.524199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1072/2142] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:50.525864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbb2e8-8653-4646-b616-c2b4681bb00b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:50.546967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1071/2143] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:50.565054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbb2e8-8653-4646-b616-c2b4681bb00b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:50.570499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bb45e-ce6c-4ca5-a75f-9d690ed82018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:50.571336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bb45e-ce6c-4ca5-a75f-9d690ed82018 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:50.571703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bb45e-ce6c-4ca5-a75f-9d690ed82018 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:50.572078 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bb45e-ce6c-4ca5-a75f-9d690ed82018 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.573241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bb45e-ce6c-4ca5-a75f-9d690ed82018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:50.575320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bb45e-ce6c-4ca5-a75f-9d690ed82018 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:50.601143 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1073/2144] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:50.605875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7b18-0725-41ab-b359-d1b14d55b2bc service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:50.624524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7b18-0725-41ab-b359-d1b14d55b2bc service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:50.637938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fab3c-222c-4dde-8b6a-bfbfc165f00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:50.639043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fab3c-222c-4dde-8b6a-bfbfc165f00c admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:50.639043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fab3c-222c-4dde-8b6a-bfbfc165f00c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:50.639486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fab3c-222c-4dde-8b6a-bfbfc165f00c admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.640304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fab3c-222c-4dde-8b6a-bfbfc165f00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:50.642182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fab3c-222c-4dde-8b6a-bfbfc165f00c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:50.669926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1072/2145] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:50.674323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bb45e-ce6c-4ca5-a75f-9d690ed82018 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:50.695931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bb45e-ce6c-4ca5-a75f-9d690ed82018 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:50.702143 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18998bac-66e8-45a5-adb2-def9dbd63104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:50.703290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998bac-66e8-45a5-adb2-def9dbd63104 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:50.703725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998bac-66e8-45a5-adb2-def9dbd63104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:50.704097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998bac-66e8-45a5-adb2-def9dbd63104 admin admin] PATH_INFO: `/v3/projects/44c3df6d930a46b38a9a7c92f4cbdab8/users/399e6a6b05cc4e4cb16f45067ac308f7/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.735561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18998bac-66e8-45a5-adb2-def9dbd63104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c3df6d930a46b38a9a7c92f4cbdab8, user_id=399e6a6b05cc4e4cb16f45067ac308f7, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:50.743577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18998bac-66e8-45a5-adb2-def9dbd63104 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:50.747441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:50.770509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1074/2146] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:50 2022] PUT /identity/v3/projects/44c3df6d930a46b38a9a7c92f4cbdab8/users/399e6a6b05cc4e4cb16f45067ac308f7/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:50.782388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eed4f-088d-48f2-82fd-4a7fe8e69df9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:50.782805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eed4f-088d-48f2-82fd-4a7fe8e69df9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:50.783186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eed4f-088d-48f2-82fd-4a7fe8e69df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:50.845436 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c73eed4f-088d-48f2-82fd-4a7fe8e69df9 None None] MFA Rules not processed for user `399e6a6b05cc4e4cb16f45067ac308f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:50.847278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c73eed4f-088d-48f2-82fd-4a7fe8e69df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:51.016271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1073/2147] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:50 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:51.020992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18998bac-66e8-45a5-adb2-def9dbd63104 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:51.096777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18998bac-66e8-45a5-adb2-def9dbd63104 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:51.104256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ce12-af24-4afb-9ea3-f82c5f0e775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:51.104877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ce12-af24-4afb-9ea3-f82c5f0e775c admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:51.105161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ce12-af24-4afb-9ea3-f82c5f0e775c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:51.105434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ce12-af24-4afb-9ea3-f82c5f0e775c admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:51.106070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62ce12-af24-4afb-9ea3-f82c5f0e775c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:51.108455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62ce12-af24-4afb-9ea3-f82c5f0e775c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:51.142344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1075/2148] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:51 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:51.146317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eed4f-088d-48f2-82fd-4a7fe8e69df9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:51.160050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eed4f-088d-48f2-82fd-4a7fe8e69df9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:51.232352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860f9c-dd86-4c03-8ed4-faf6cd7781cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:51.233043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860f9c-dd86-4c03-8ed4-faf6cd7781cd admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:51.233241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860f9c-dd86-4c03-8ed4-faf6cd7781cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:51.233515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860f9c-dd86-4c03-8ed4-faf6cd7781cd admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:51.234225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860f9c-dd86-4c03-8ed4-faf6cd7781cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:51.236345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860f9c-dd86-4c03-8ed4-faf6cd7781cd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:51.274706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1074/2149] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:51 2022] POST /identity/v3/users => generated 307 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:51.279736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ce12-af24-4afb-9ea3-f82c5f0e775c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:51.302433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ce12-af24-4afb-9ea3-f82c5f0e775c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:51.308965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab8e6-580d-46b4-a09e-87a4da0093db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:51.309579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab8e6-580d-46b4-a09e-87a4da0093db admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:51.310062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab8e6-580d-46b4-a09e-87a4da0093db admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:51.310339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab8e6-580d-46b4-a09e-87a4da0093db admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:51.311365 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aab8e6-580d-46b4-a09e-87a4da0093db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:51.312733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aab8e6-580d-46b4-a09e-87a4da0093db admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:51.325764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1076/2150] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:48:51.330183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860f9c-dd86-4c03-8ed4-faf6cd7781cd admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:51.337016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:51.341546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860f9c-dd86-4c03-8ed4-faf6cd7781cd admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:51.347780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af447847-c12e-49ab-afdb-5c203a1856d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:51.348644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af447847-c12e-49ab-afdb-5c203a1856d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:51.348921 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af447847-c12e-49ab-afdb-5c203a1856d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:51.349198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af447847-c12e-49ab-afdb-5c203a1856d2 admin admin] PATH_INFO: `/v3/projects/5dc8163a7e69481e89ea641fc181cf13/users/54e610e2694b4007bb3ebc63bbf7d9d8/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:51.367015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af447847-c12e-49ab-afdb-5c203a1856d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc8163a7e69481e89ea641fc181cf13, user_id=54e610e2694b4007bb3ebc63bbf7d9d8, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:51.370425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af447847-c12e-49ab-afdb-5c203a1856d2 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:51.386058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1075/2151] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:51 2022] PUT /identity/v3/projects/5dc8163a7e69481e89ea641fc181cf13/users/54e610e2694b4007bb3ebc63bbf7d9d8/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:51.390338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab8e6-580d-46b4-a09e-87a4da0093db admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:51.401705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab8e6-580d-46b4-a09e-87a4da0093db admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:51.478165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651e007-1ced-4159-b4d4-e5498fc0ae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:51.478894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e007-1ced-4159-b4d4-e5498fc0ae6b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:51.479177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e007-1ced-4159-b4d4-e5498fc0ae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:51.479447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e007-1ced-4159-b4d4-e5498fc0ae6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:51.480097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651e007-1ced-4159-b4d4-e5498fc0ae6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:51.481755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651e007-1ced-4159-b4d4-e5498fc0ae6b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:51.494805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1077/2152] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:51.498423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af447847-c12e-49ab-afdb-5c203a1856d2 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:51.509894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af447847-c12e-49ab-afdb-5c203a1856d2 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:51.514892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841870c1-65fb-4817-b9a5-0df46336ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:51.515602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841870c1-65fb-4817-b9a5-0df46336ce5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:51.515874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841870c1-65fb-4817-b9a5-0df46336ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:51.516149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841870c1-65fb-4817-b9a5-0df46336ce5d admin admin] PATH_INFO: `/v3/projects/5dc8163a7e69481e89ea641fc181cf13/users/54e610e2694b4007bb3ebc63bbf7d9d8/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:51.519006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841870c1-65fb-4817-b9a5-0df46336ce5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc8163a7e69481e89ea641fc181cf13, user_id=54e610e2694b4007bb3ebc63bbf7d9d8, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:51.522358 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841870c1-65fb-4817-b9a5-0df46336ce5d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:51.534380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1076/2153] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:51 2022] PUT /identity/v3/projects/5dc8163a7e69481e89ea641fc181cf13/users/54e610e2694b4007bb3ebc63bbf7d9d8/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:51.546524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c5bbc-46d3-4a51-be5f-25a9c335074b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:51.547135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c5bbc-46d3-4a51-be5f-25a9c335074b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:51.547229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c5bbc-46d3-4a51-be5f-25a9c335074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:51.580391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-cc8c5bbc-46d3-4a51-be5f-25a9c335074b None None] MFA Rules not processed for user `54e610e2694b4007bb3ebc63bbf7d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:51.581693 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-cc8c5bbc-46d3-4a51-be5f-25a9c335074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:51.640067 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:51.663043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1078/2154] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:51 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:51.675324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841870c1-65fb-4817-b9a5-0df46336ce5d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:51.677142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-841870c1-65fb-4817-b9a5-0df46336ce5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:51.738705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841870c1-65fb-4817-b9a5-0df46336ce5d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:51.743034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a87c-e4ad-42c5-ad25-05ebfcabfee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:51.743696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a87c-e4ad-42c5-ad25-05ebfcabfee2 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:51.744016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a87c-e4ad-42c5-ad25-05ebfcabfee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:51.744311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a87c-e4ad-42c5-ad25-05ebfcabfee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:51.753905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319a87c-e4ad-42c5-ad25-05ebfcabfee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:51.755505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319a87c-e4ad-42c5-ad25-05ebfcabfee2 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:51.770816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1077/2155] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:51 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:51.852749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c5bbc-46d3-4a51-be5f-25a9c335074b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:51.864815 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c5bbc-46d3-4a51-be5f-25a9c335074b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:51.874640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0c882-649e-449f-a706-b5a9b9a2bdf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:51.875666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0c882-649e-449f-a706-b5a9b9a2bdf9 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:51.875953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0c882-649e-449f-a706-b5a9b9a2bdf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:51.876230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0c882-649e-449f-a706-b5a9b9a2bdf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:51.977319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0c882-649e-449f-a706-b5a9b9a2bdf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:51.979738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0c882-649e-449f-a706-b5a9b9a2bdf9 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:52.015532 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1079/2156] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:51 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:54.048295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a87c-e4ad-42c5-ad25-05ebfcabfee2 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:54.049736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7319a87c-e4ad-42c5-ad25-05ebfcabfee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:54.121012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a87c-e4ad-42c5-ad25-05ebfcabfee2 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:54.125782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:54.127125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:54.127592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:54.127881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] PATH_INFO: `/v3/users/f31e9e73270d492b89c87a4fd3158b79` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:54.129039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31e9e73270d492b89c87a4fd3158b79)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:54.132269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:54.183372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31e9e73270d492b89c87a4fd3158b79'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.191492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31e9e73270d492b89c87a4fd3158b79'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.200391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31e9e73270d492b89c87a4fd3158b79'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.207964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:54.215202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31e9e73270d492b89c87a4fd3158b79'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.215927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31e9e73270d492b89c87a4fd3158b79'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.223281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1078/2157] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:54 2022] DELETE /identity/v3/users/f31e9e73270d492b89c87a4fd3158b79 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:54.228013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a51e-f0e5-4cb1-a03e-b14f76e6af4c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:54.228618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a51e-f0e5-4cb1-a03e-b14f76e6af4c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:54.228618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a51e-f0e5-4cb1-a03e-b14f76e6af4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:54.250747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ea13a51e-f0e5-4cb1-a03e-b14f76e6af4c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:54.251930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ea13a51e-f0e5-4cb1-a03e-b14f76e6af4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:54.314165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1080/2158] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:54.325195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:54.326734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:54.388873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d6765-9039-4907-947c-dda58c8bf669 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:54.393210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1b476-69bb-48c1-b04c-a50b9f8ac699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:54.393872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1b476-69bb-48c1-b04c-a50b9f8ac699 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:54.394205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1b476-69bb-48c1-b04c-a50b9f8ac699 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:54.394563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1b476-69bb-48c1-b04c-a50b9f8ac699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:54.410170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1b476-69bb-48c1-b04c-a50b9f8ac699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:54.411657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1b476-69bb-48c1-b04c-a50b9f8ac699 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:54.422318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1079/2159] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:54.796751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a51e-f0e5-4cb1-a03e-b14f76e6af4c None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:54.798209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ea13a51e-f0e5-4cb1-a03e-b14f76e6af4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:54.811150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a51e-f0e5-4cb1-a03e-b14f76e6af4c None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:54.815725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:54.816359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:54.816638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:54.816907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] PATH_INFO: `/v3/projects/10381163e1974af898294db9e8005276` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:54.818236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10381163e1974af898294db9e8005276)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:54.821486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:54.870626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10381163e1974af898294db9e8005276', 'request_id': 'req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.876103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10381163e1974af898294db9e8005276', 'request_id': 'req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.887190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10381163e1974af898294db9e8005276', 'request_id': 'req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.899230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] The token cache is being invalidate because project 10381163e1974af898294db9e8005276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:54.899516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.900308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:54.901814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1081/2160] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:54 2022] DELETE /identity/v3/projects/10381163e1974af898294db9e8005276 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:54.905793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1b476-69bb-48c1-b04c-a50b9f8ac699 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:54.916098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1b476-69bb-48c1-b04c-a50b9f8ac699 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:54.998424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:54.999324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:54.999783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:55.000108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] PATH_INFO: `/v3/users/f6b498808fd84e969466e40508d73c20` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:55.001712 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b498808fd84e969466e40508d73c20)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:55.003764 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:55.069496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b498808fd84e969466e40508d73c20'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.079913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b498808fd84e969466e40508d73c20'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.089776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b498808fd84e969466e40508d73c20'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.120797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b498808fd84e969466e40508d73c20'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.120797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b498808fd84e969466e40508d73c20'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.128679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1080/2161] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:54 2022] DELETE /identity/v3/users/f6b498808fd84e969466e40508d73c20 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:55.470804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:55.472284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:55.487625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc96b-9f21-4cd2-bdda-d8fd8bf43750 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:55.515430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:55.580325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:55.581129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:55.581291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:55.581643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] PATH_INFO: `/v3/projects/70c58447eff34aa687ae0466d686e938` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:55.582656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c58447eff34aa687ae0466d686e938)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:55.585376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:55.662355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c58447eff34aa687ae0466d686e938', 'request_id': 'req-c377fe53-ad95-43df-a272-c4da29ece602'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.669170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c58447eff34aa687ae0466d686e938', 'request_id': 'req-c377fe53-ad95-43df-a272-c4da29ece602'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.678255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c58447eff34aa687ae0466d686e938', 'request_id': 'req-c377fe53-ad95-43df-a272-c4da29ece602'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.693459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] The token cache is being invalidate because project 70c58447eff34aa687ae0466d686e938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:55.693882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.694943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.697798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1082/2162] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:55 2022] DELETE /identity/v3/projects/70c58447eff34aa687ae0466d686e938 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:55.702285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:55.703900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:55.718337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1bb92-9810-4e3b-896f-8c315383fe72 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:55.729772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:55.793815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:55.794407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:55.794684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:55.794989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] PATH_INFO: `/v3/users/45d0030c9f924bdc94b693a3dde97e25` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:55.796111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d0030c9f924bdc94b693a3dde97e25)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:55.798536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:55.846484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d0030c9f924bdc94b693a3dde97e25'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.853997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d0030c9f924bdc94b693a3dde97e25'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.861161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d0030c9f924bdc94b693a3dde97e25'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.881767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d0030c9f924bdc94b693a3dde97e25'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.883701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9f363200-3d38-4499-a899-b7ac3a7c1e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d0030c9f924bdc94b693a3dde97e25'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:55.890624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1081/2163] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:55 2022] DELETE /identity/v3/users/45d0030c9f924bdc94b693a3dde97e25 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:56.173045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:56.174885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:56.188883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377fe53-ad95-43df-a272-c4da29ece602 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:56.250755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:56.251328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.251698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.251865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] PATH_INFO: `/v3/projects/566e172ffec94c68b67ab632c705c9a6` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.252984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566e172ffec94c68b67ab632c705c9a6)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:56.254959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:56.316233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:56.321154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566e172ffec94c68b67ab632c705c9a6', 'request_id': 'req-6fbf98b8-4985-4d01-8c24-51061d225973'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.328632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566e172ffec94c68b67ab632c705c9a6', 'request_id': 'req-6fbf98b8-4985-4d01-8c24-51061d225973'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.338502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566e172ffec94c68b67ab632c705c9a6', 'request_id': 'req-6fbf98b8-4985-4d01-8c24-51061d225973'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.350909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] The token cache is being invalidate because project 566e172ffec94c68b67ab632c705c9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:56.351087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.352592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.354248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1083/2164] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:56 2022] DELETE /identity/v3/projects/566e172ffec94c68b67ab632c705c9a6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:56.359682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e12ef-4a5e-4241-831e-28fbf6915555 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.360224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e12ef-4a5e-4241-831e-28fbf6915555 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.360393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e12ef-4a5e-4241-831e-28fbf6915555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.380862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-320e12ef-4a5e-4241-831e-28fbf6915555 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:56.382166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-320e12ef-4a5e-4241-831e-28fbf6915555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:56.423452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:56.424929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:56.449641 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1082/2165] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:56.458853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f31774-3e0c-4568-8a2b-d53a39fe81fc None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.459193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f31774-3e0c-4568-8a2b-d53a39fe81fc None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.459557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f31774-3e0c-4568-8a2b-d53a39fe81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.480746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-51f31774-3e0c-4568-8a2b-d53a39fe81fc None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:56.482016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-51f31774-3e0c-4568-8a2b-d53a39fe81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:56.490318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1083/2166] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:48:56.495103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f31774-3e0c-4568-8a2b-d53a39fe81fc None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:56.498185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf98b8-4985-4d01-8c24-51061d225973 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:56.503305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:56.503948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.504228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.504504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] PATH_INFO: `/v3/users/399e6a6b05cc4e4cb16f45067ac308f7` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.505073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f31774-3e0c-4568-8a2b-d53a39fe81fc None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:56.505649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] RBAC: Authorizing `identity:delete_user(user_id=399e6a6b05cc4e4cb16f45067ac308f7)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:56.508282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:56.511097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf587d-e585-4f99-af65-97631ef5025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:56.511825 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf587d-e585-4f99-af65-97631ef5025f admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.512112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf587d-e585-4f99-af65-97631ef5025f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.512388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf587d-e585-4f99-af65-97631ef5025f admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.513103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf587d-e585-4f99-af65-97631ef5025f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:56.513462 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf587d-e585-4f99-af65-97631ef5025f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:56.515130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf587d-e585-4f99-af65-97631ef5025f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:56.529876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1084/2167] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:48:56.533950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf587d-e585-4f99-af65-97631ef5025f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:56.547236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf587d-e585-4f99-af65-97631ef5025f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:56.552874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2a44-80c6-4675-869d-a91e1e3e7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:56.553633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2a44-80c6-4675-869d-a91e1e3e7f69 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.553915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2a44-80c6-4675-869d-a91e1e3e7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.554193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2a44-80c6-4675-869d-a91e1e3e7f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.555678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c2a44-80c6-4675-869d-a91e1e3e7f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:56.557626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c2a44-80c6-4675-869d-a91e1e3e7f69 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:56.566918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399e6a6b05cc4e4cb16f45067ac308f7'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.567509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399e6a6b05cc4e4cb16f45067ac308f7'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.569095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:56.583356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399e6a6b05cc4e4cb16f45067ac308f7'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.589954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1085/2168] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:56 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:56.594963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399e6a6b05cc4e4cb16f45067ac308f7'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.595492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1e9dc1b6-4fa9-4b33-9c3a-6dfd2fcf024d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399e6a6b05cc4e4cb16f45067ac308f7'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:56.599888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2a44-80c6-4675-869d-a91e1e3e7f69 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:56.602498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-df6c2a44-80c6-4675-869d-a91e1e3e7f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:56.611363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1084/2169] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:56 2022] DELETE /identity/v3/users/399e6a6b05cc4e4cb16f45067ac308f7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:56.615460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92785fe-caf2-4793-b328-d8ddb96ced07 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.615727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92785fe-caf2-4793-b328-d8ddb96ced07 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.616003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92785fe-caf2-4793-b328-d8ddb96ced07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.637731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d92785fe-caf2-4793-b328-d8ddb96ced07 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:56.639049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d92785fe-caf2-4793-b328-d8ddb96ced07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:56.730028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:56.749479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2a44-80c6-4675-869d-a91e1e3e7f69 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:56.754816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1085/2170] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:56.756012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe981d-a9be-4e61-a90b-ba442300dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:56.756518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe981d-a9be-4e61-a90b-ba442300dfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.756801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe981d-a9be-4e61-a90b-ba442300dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.757081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe981d-a9be-4e61-a90b-ba442300dfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.759701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe981d-a9be-4e61-a90b-ba442300dfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:56.762005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe981d-a9be-4e61-a90b-ba442300dfe7 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:56.775707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92785fe-caf2-4793-b328-d8ddb96ced07 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:56.781790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d92785fe-caf2-4793-b328-d8ddb96ced07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:56.804524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1086/2171] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:56 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:56.808816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe981d-a9be-4e61-a90b-ba442300dfe7 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:56.828227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe981d-a9be-4e61-a90b-ba442300dfe7 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:56.828227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ca2a5-e8c4-4318-871e-fc1f5bf251bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:56.828227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ca2a5-e8c4-4318-871e-fc1f5bf251bd admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.828227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ca2a5-e8c4-4318-871e-fc1f5bf251bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.828606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ca2a5-e8c4-4318-871e-fc1f5bf251bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.828606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ca2a5-e8c4-4318-871e-fc1f5bf251bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:56.829827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ca2a5-e8c4-4318-871e-fc1f5bf251bd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:56.864201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1087/2172] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:56.866343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ca2a5-e8c4-4318-871e-fc1f5bf251bd admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:56.884062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92785fe-caf2-4793-b328-d8ddb96ced07 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:56.888556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ca2a5-e8c4-4318-871e-fc1f5bf251bd admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:56.894215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66a2c-afc0-420a-9afb-2a1f45684641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:56.895427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66a2c-afc0-420a-9afb-2a1f45684641 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.895707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66a2c-afc0-420a-9afb-2a1f45684641 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.895976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66a2c-afc0-420a-9afb-2a1f45684641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.899933 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93482142-d240-4118-86b8-dedc6e3eb36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:56.900523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93482142-d240-4118-86b8-dedc6e3eb36a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.901403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93482142-d240-4118-86b8-dedc6e3eb36a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.901403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93482142-d240-4118-86b8-dedc6e3eb36a admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.901700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93482142-d240-4118-86b8-dedc6e3eb36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:56.903361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93482142-d240-4118-86b8-dedc6e3eb36a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:56.907600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e66a2c-afc0-420a-9afb-2a1f45684641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:56.909124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e66a2c-afc0-420a-9afb-2a1f45684641 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:56.917858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1088/2173] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:56.921660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1086/2174] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:56.922703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93482142-d240-4118-86b8-dedc6e3eb36a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:56.938323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93482142-d240-4118-86b8-dedc6e3eb36a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:56.943926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ebff1-6a0b-4579-9b62-da922ae16a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:56.947534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ebff1-6a0b-4579-9b62-da922ae16a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:56.947912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ebff1-6a0b-4579-9b62-da922ae16a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:56.948378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ebff1-6a0b-4579-9b62-da922ae16a3d admin admin] PATH_INFO: `/v3/projects/112bd465eb73460bb1ca48ec85e96748/users/a5399e7179fe43a1826473d83e8e5c16/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:56.976050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ebff1-6a0b-4579-9b62-da922ae16a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=112bd465eb73460bb1ca48ec85e96748, user_id=a5399e7179fe43a1826473d83e8e5c16, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:56.978997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ebff1-6a0b-4579-9b62-da922ae16a3d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:57.000125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1089/2175] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:56 2022] PUT /identity/v3/projects/112bd465eb73460bb1ca48ec85e96748/users/a5399e7179fe43a1826473d83e8e5c16/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:57.006050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57adb16-8672-4a31-963f-318a62a45269 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:57.006559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57adb16-8672-4a31-963f-318a62a45269 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:57.007016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57adb16-8672-4a31-963f-318a62a45269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:57.036745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b57adb16-8672-4a31-963f-318a62a45269 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:57.038171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b57adb16-8672-4a31-963f-318a62a45269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:57.116671 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1087/2176] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:57.142728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ebff1-6a0b-4579-9b62-da922ae16a3d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:57.219412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ebff1-6a0b-4579-9b62-da922ae16a3d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:57.223504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8d551-ecf5-48b6-b5c9-11cc23306df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:57.224224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8d551-ecf5-48b6-b5c9-11cc23306df4 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:57.224591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8d551-ecf5-48b6-b5c9-11cc23306df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:57.224927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8d551-ecf5-48b6-b5c9-11cc23306df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:57.236292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8d551-ecf5-48b6-b5c9-11cc23306df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:57.237963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8d551-ecf5-48b6-b5c9-11cc23306df4 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:57.252073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1090/2177] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:57.331592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57adb16-8672-4a31-963f-318a62a45269 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:57.332994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b57adb16-8672-4a31-963f-318a62a45269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:57.345540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57adb16-8672-4a31-963f-318a62a45269 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:57.354907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:57.355571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:57.355854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:57.356144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] PATH_INFO: `/v3/projects/44c3df6d930a46b38a9a7c92f4cbdab8` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:57.358895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c3df6d930a46b38a9a7c92f4cbdab8)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:57.360866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:57.445930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c3df6d930a46b38a9a7c92f4cbdab8', 'request_id': 'req-8813cc37-7cf7-4925-9fc8-34092544f300'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.454830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c3df6d930a46b38a9a7c92f4cbdab8', 'request_id': 'req-8813cc37-7cf7-4925-9fc8-34092544f300'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.466933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c3df6d930a46b38a9a7c92f4cbdab8', 'request_id': 'req-8813cc37-7cf7-4925-9fc8-34092544f300'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.480410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] The token cache is being invalidate because project 44c3df6d930a46b38a9a7c92f4cbdab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:57.480771 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.481551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.486091 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1088/2178] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:57 2022] DELETE /identity/v3/projects/44c3df6d930a46b38a9a7c92f4cbdab8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:57.490269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8d551-ecf5-48b6-b5c9-11cc23306df4 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:57.502847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8d551-ecf5-48b6-b5c9-11cc23306df4 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:57.545784 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:57.587931 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:57.588592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:57.588959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:57.597291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] PATH_INFO: `/v3/users/54e610e2694b4007bb3ebc63bbf7d9d8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:57.599475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e610e2694b4007bb3ebc63bbf7d9d8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:57.603092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:57.695433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e610e2694b4007bb3ebc63bbf7d9d8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.704815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e610e2694b4007bb3ebc63bbf7d9d8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.715312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e610e2694b4007bb3ebc63bbf7d9d8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.741106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e610e2694b4007bb3ebc63bbf7d9d8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.745497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8f57b86e-4078-4c04-a6e9-5831819f9966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e610e2694b4007bb3ebc63bbf7d9d8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:57.754215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1091/2179] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:57 2022] DELETE /identity/v3/users/54e610e2694b4007bb3ebc63bbf7d9d8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:58.147403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:58.149299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:58.165130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813cc37-7cf7-4925-9fc8-34092544f300 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:58.193396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:58.264020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:58.264986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.265477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.266165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] PATH_INFO: `/v3/projects/5dc8163a7e69481e89ea641fc181cf13` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.267702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc8163a7e69481e89ea641fc181cf13)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:58.270046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:58.346639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc8163a7e69481e89ea641fc181cf13', 'request_id': 'req-90904cb1-db8c-480a-9d1d-47214d6410de'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.355687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f6985-12b8-4f37-bf15-d692cbec3bfa None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.356023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f6985-12b8-4f37-bf15-d692cbec3bfa None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.356339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f6985-12b8-4f37-bf15-d692cbec3bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.361496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc8163a7e69481e89ea641fc181cf13', 'request_id': 'req-90904cb1-db8c-480a-9d1d-47214d6410de'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.384403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc8163a7e69481e89ea641fc181cf13', 'request_id': 'req-90904cb1-db8c-480a-9d1d-47214d6410de'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.399079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] The token cache is being invalidate because project 5dc8163a7e69481e89ea641fc181cf13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:58.399518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.400399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.401393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-bf9f6985-12b8-4f37-bf15-d692cbec3bfa None None] MFA Rules not processed for user `a5399e7179fe43a1826473d83e8e5c16`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:58.402434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1089/2180] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:58 2022] DELETE /identity/v3/projects/5dc8163a7e69481e89ea641fc181cf13 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:58.402752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bf9f6985-12b8-4f37-bf15-d692cbec3bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:58.403278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:58.404589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:58.520399 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904cb1-db8c-480a-9d1d-47214d6410de admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:58.528154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:58.528966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.529258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.529546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] PATH_INFO: `/v3/users/afe254db3023480d8c93cfa118f10d48` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.529969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1092/2181] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:58.531059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe254db3023480d8c93cfa118f10d48)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:58.531571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6b876-5fb7-491c-8dae-c564fd04b87b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.531930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6b876-5fb7-491c-8dae-c564fd04b87b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.532274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6b876-5fb7-491c-8dae-c564fd04b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.532992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:58.555191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-01f6b876-5fb7-491c-8dae-c564fd04b87b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:58.556736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-01f6b876-5fb7-491c-8dae-c564fd04b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:58.576447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1093/2182] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:58.577464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6b876-5fb7-491c-8dae-c564fd04b87b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:58.578945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-01f6b876-5fb7-491c-8dae-c564fd04b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:58.604395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe254db3023480d8c93cfa118f10d48'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.605152 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe254db3023480d8c93cfa118f10d48'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.607274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:58.620282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe254db3023480d8c93cfa118f10d48'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.630983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe254db3023480d8c93cfa118f10d48'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.631784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a11758f4-531b-472a-951d-585fa73a1260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe254db3023480d8c93cfa118f10d48'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:58.640189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:58.646267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1090/2183] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:58 2022] DELETE /identity/v3/users/afe254db3023480d8c93cfa118f10d48 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:58.647543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d33f31-e2b7-413b-8951-2b16605abe44 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.647830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d33f31-e2b7-413b-8951-2b16605abe44 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.649205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d33f31-e2b7-413b-8951-2b16605abe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.672798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6b876-5fb7-491c-8dae-c564fd04b87b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:58.677218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-11d33f31-e2b7-413b-8951-2b16605abe44 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:58.678873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-11d33f31-e2b7-413b-8951-2b16605abe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:58.728213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:58.729082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.729796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.730138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.732018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:58.747854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1091/2184] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:58.751554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b681f-9148-45a3-8c11-7b7eae770f01 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.751554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b681f-9148-45a3-8c11-7b7eae770f01 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.751554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b681f-9148-45a3-8c11-7b7eae770f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.769610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-902b681f-9148-45a3-8c11-7b7eae770f01 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:58.770870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-902b681f-9148-45a3-8c11-7b7eae770f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:58.779062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1092/2185] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:58.779858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b681f-9148-45a3-8c11-7b7eae770f01 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:58.792396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b681f-9148-45a3-8c11-7b7eae770f01 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:58.796983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0553c-84ff-41d4-b706-44be82e033d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:58.797584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0553c-84ff-41d4-b706-44be82e033d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.797859 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0553c-84ff-41d4-b706-44be82e033d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.798125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0553c-84ff-41d4-b706-44be82e033d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.798793 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0553c-84ff-41d4-b706-44be82e033d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:48:58.799092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0553c-84ff-41d4-b706-44be82e033d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:58.800673 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0553c-84ff-41d4-b706-44be82e033d2 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:58.800972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:58.802411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:58.812980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1094/2186] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:58.816577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1093/2187] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:48:58.816703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:58.816703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:58.820006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0553c-84ff-41d4-b706-44be82e033d2 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:58.832029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0553c-84ff-41d4-b706-44be82e033d2 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:58.837138 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a074e01-997b-47d7-ac46-f07f97c08739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:58.837954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a074e01-997b-47d7-ac46-f07f97c08739 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.838300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a074e01-997b-47d7-ac46-f07f97c08739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.838654 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a074e01-997b-47d7-ac46-f07f97c08739 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.839386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a074e01-997b-47d7-ac46-f07f97c08739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:58.841664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a074e01-997b-47d7-ac46-f07f97c08739 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:58.877612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1094/2188] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:58 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:58.884287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a074e01-997b-47d7-ac46-f07f97c08739 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:58.886892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41f2f7-12ff-4a8e-bc22-ead1b86ea6f4 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:58.966251 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f85a-8239-4ef8-bb00-ee4ad6bcfe8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:58.967057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f85a-8239-4ef8-bb00-ee4ad6bcfe8b service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.967340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f85a-8239-4ef8-bb00-ee4ad6bcfe8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.967616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f85a-8239-4ef8-bb00-ee4ad6bcfe8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.972750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a074e01-997b-47d7-ac46-f07f97c08739 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:58.983555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f85a-8239-4ef8-bb00-ee4ad6bcfe8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:58.985563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f85a-8239-4ef8-bb00-ee4ad6bcfe8b service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:58.987691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dba0-83d4-4c01-846d-81352ba1fab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:58.988630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dba0-83d4-4c01-846d-81352ba1fab7 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:58.988968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dba0-83d4-4c01-846d-81352ba1fab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:58.989438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dba0-83d4-4c01-846d-81352ba1fab7 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:58.990498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6dba0-83d4-4c01-846d-81352ba1fab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:58.994800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6dba0-83d4-4c01-846d-81352ba1fab7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:58.999660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1095/2189] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:59.020950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1095/2190] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:58 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:59.025079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f85a-8239-4ef8-bb00-ee4ad6bcfe8b service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.039400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f85a-8239-4ef8-bb00-ee4ad6bcfe8b service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:59.046986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5264-715a-4620-90b4-9eb69aa95052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:59.047709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5264-715a-4620-90b4-9eb69aa95052 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:59.048085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5264-715a-4620-90b4-9eb69aa95052 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:59.048450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5264-715a-4620-90b4-9eb69aa95052 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:59.049247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5264-715a-4620-90b4-9eb69aa95052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:59.051598 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5264-715a-4620-90b4-9eb69aa95052 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:59.053770 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:59.073622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dba0-83d4-4c01-846d-81352ba1fab7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.081519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1096/2191] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:59.087514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dba0-83d4-4c01-846d-81352ba1fab7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:59.093050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963b148-18ff-4524-a60e-04f1d30e252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:59.093740 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963b148-18ff-4524-a60e-04f1d30e252b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:59.094099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963b148-18ff-4524-a60e-04f1d30e252b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:59.094445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963b148-18ff-4524-a60e-04f1d30e252b admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:59.096398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963b148-18ff-4524-a60e-04f1d30e252b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:59.098333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963b148-18ff-4524-a60e-04f1d30e252b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:59.112220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1096/2192] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:59.117561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5264-715a-4620-90b4-9eb69aa95052 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.134477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5264-715a-4620-90b4-9eb69aa95052 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:59.154680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f033f3a-edbb-46ed-b202-cba5200c0376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:59.159304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033f3a-edbb-46ed-b202-cba5200c0376 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:59.159821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033f3a-edbb-46ed-b202-cba5200c0376 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:59.160553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033f3a-edbb-46ed-b202-cba5200c0376 admin admin] PATH_INFO: `/v3/projects/6f21b88ef5ea4880a8ac84f9c99299ed/users/be6539dbf4dd41e28da52d671d7eedb4/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:59.200400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f033f3a-edbb-46ed-b202-cba5200c0376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f21b88ef5ea4880a8ac84f9c99299ed, user_id=be6539dbf4dd41e28da52d671d7eedb4, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:59.203881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f033f3a-edbb-46ed-b202-cba5200c0376 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:59.221387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1097/2193] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:59 2022] PUT /identity/v3/projects/6f21b88ef5ea4880a8ac84f9c99299ed/users/be6539dbf4dd41e28da52d671d7eedb4/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:59.233926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8337-b922-449b-ba5b-b8c49051d7af None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:59.234614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8337-b922-449b-ba5b-b8c49051d7af None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:59.234614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8337-b922-449b-ba5b-b8c49051d7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:59.253536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:59.283452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-6dae8337-b922-449b-ba5b-b8c49051d7af None None] MFA Rules not processed for user `be6539dbf4dd41e28da52d671d7eedb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:59.284842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6dae8337-b922-449b-ba5b-b8c49051d7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:59.399182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1097/2194] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:59.403649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f033f3a-edbb-46ed-b202-cba5200c0376 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.489887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f033f3a-edbb-46ed-b202-cba5200c0376 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:59.498064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f94bf5-744d-4eb4-96ba-289e440dfa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:59.499686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f94bf5-744d-4eb4-96ba-289e440dfa20 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:59.500127 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f94bf5-744d-4eb4-96ba-289e440dfa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:59.500550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f94bf5-744d-4eb4-96ba-289e440dfa20 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:59.501854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f94bf5-744d-4eb4-96ba-289e440dfa20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:59.504053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f94bf5-744d-4eb4-96ba-289e440dfa20 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:59.544042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1098/2195] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:48:59 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:48:59.546068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8337-b922-449b-ba5b-b8c49051d7af None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.566112 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8337-b922-449b-ba5b-b8c49051d7af None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:59.642246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f94bf5-744d-4eb4-96ba-289e440dfa20 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.643404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d7f94bf5-744d-4eb4-96ba-289e440dfa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:59.661672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b226dfa-608e-4acf-a573-4f26911aa9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:59.662638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226dfa-608e-4acf-a573-4f26911aa9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:59.663074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226dfa-608e-4acf-a573-4f26911aa9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:59.664358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226dfa-608e-4acf-a573-4f26911aa9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:59.666058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b226dfa-608e-4acf-a573-4f26911aa9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:59.672438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b226dfa-608e-4acf-a573-4f26911aa9a5 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:59.707025 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1098/2196] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:48:59 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:48:59.714955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b226dfa-608e-4acf-a573-4f26911aa9a5 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.736258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b226dfa-608e-4acf-a573-4f26911aa9a5 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:59.745558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad65922-e842-4854-975c-fe8c85fefec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:59.746365 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad65922-e842-4854-975c-fe8c85fefec6 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:59.748323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad65922-e842-4854-975c-fe8c85fefec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:59.749110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad65922-e842-4854-975c-fe8c85fefec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:59.749972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad65922-e842-4854-975c-fe8c85fefec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:59.752226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad65922-e842-4854-975c-fe8c85fefec6 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:59.770778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1099/2197] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:48:59.771074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f94bf5-744d-4eb4-96ba-289e440dfa20 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:59.775980 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad65922-e842-4854-975c-fe8c85fefec6 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.778679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:59.779389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:59.779676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:59.780416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] PATH_INFO: `/v3/projects/130e6c8d52464d7c86c92080738a0f81` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:59.781485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130e6c8d52464d7c86c92080738a0f81)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:59.783583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:59.790034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad65922-e842-4854-975c-fe8c85fefec6 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:59.795748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01c53c-7cb1-4305-ad1e-0bdbd3219cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:59.796576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01c53c-7cb1-4305-ad1e-0bdbd3219cad admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:59.796774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01c53c-7cb1-4305-ad1e-0bdbd3219cad admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:59.796962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01c53c-7cb1-4305-ad1e-0bdbd3219cad admin admin] PATH_INFO: `/v3/projects/202f7a3b3fec4074848a30d9acaee962/users/d5ad99e2ec6c42b2b48461fcb3416f32/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:59.814294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01c53c-7cb1-4305-ad1e-0bdbd3219cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=202f7a3b3fec4074848a30d9acaee962, user_id=d5ad99e2ec6c42b2b48461fcb3416f32, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:59.817071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01c53c-7cb1-4305-ad1e-0bdbd3219cad admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:59.837594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1100/2198] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:48:59 2022] PUT /identity/v3/projects/202f7a3b3fec4074848a30d9acaee962/users/d5ad99e2ec6c42b2b48461fcb3416f32/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:48:59.843185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01c53c-7cb1-4305-ad1e-0bdbd3219cad admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.856469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130e6c8d52464d7c86c92080738a0f81', 'request_id': 'req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:59.864096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130e6c8d52464d7c86c92080738a0f81', 'request_id': 'req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:59.868725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:59.878368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130e6c8d52464d7c86c92080738a0f81', 'request_id': 'req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:59.899070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] The token cache is being invalidate because project 130e6c8d52464d7c86c92080738a0f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:48:59.899856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:59.900844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:48:59.902930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1099/2199] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:48:59 2022] DELETE /identity/v3/projects/130e6c8d52464d7c86c92080738a0f81 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:48:59.907872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:59.908044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:59.909415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:59.925401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01c53c-7cb1-4305-ad1e-0bdbd3219cad admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:00.003107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5c4f9-ecd1-4f5d-880e-32105feae0c6 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:00.011613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:00.012341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:00.012813 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:00.013152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] PATH_INFO: `/v3/users/6a932a53221e4c8ca6d833bf8b25148c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:00.014519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a932a53221e4c8ca6d833bf8b25148c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:00.016897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:00.024043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321a4a-fc48-4b2d-98d6-b820e34467c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:00.025244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321a4a-fc48-4b2d-98d6-b820e34467c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:00.025735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321a4a-fc48-4b2d-98d6-b820e34467c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:00.026255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321a4a-fc48-4b2d-98d6-b820e34467c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:00.027180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e321a4a-fc48-4b2d-98d6-b820e34467c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:00.029276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e321a4a-fc48-4b2d-98d6-b820e34467c1 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:00.046234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1101/2200] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:00.050854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321a4a-fc48-4b2d-98d6-b820e34467c1 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:00.052958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5e321a4a-fc48-4b2d-98d6-b820e34467c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:00.067367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321a4a-fc48-4b2d-98d6-b820e34467c1 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:00.073579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b84b-da7e-4764-9d7f-3dfd099b52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:00.074252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b84b-da7e-4764-9d7f-3dfd099b52ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:00.074572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b84b-da7e-4764-9d7f-3dfd099b52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:00.074840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b84b-da7e-4764-9d7f-3dfd099b52ef admin admin] PATH_INFO: `/v3/projects/202f7a3b3fec4074848a30d9acaee962/users/d5ad99e2ec6c42b2b48461fcb3416f32/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:00.075990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a932a53221e4c8ca6d833bf8b25148c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:00.076970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8b84b-da7e-4764-9d7f-3dfd099b52ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=202f7a3b3fec4074848a30d9acaee962, user_id=d5ad99e2ec6c42b2b48461fcb3416f32, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:00.079674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8b84b-da7e-4764-9d7f-3dfd099b52ef admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:00.087156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a932a53221e4c8ca6d833bf8b25148c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:00.093258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1102/2201] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:00 2022] PUT /identity/v3/projects/202f7a3b3fec4074848a30d9acaee962/users/d5ad99e2ec6c42b2b48461fcb3416f32/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:00.096614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a932a53221e4c8ca6d833bf8b25148c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:00.105905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c20c2-91bb-42d8-8814-4cd5daa4db65 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:00.106204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c20c2-91bb-42d8-8814-4cd5daa4db65 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:00.106478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c20c2-91bb-42d8-8814-4cd5daa4db65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:00.113868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a932a53221e4c8ca6d833bf8b25148c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:00.114319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a932a53221e4c8ca6d833bf8b25148c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:00.122355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1100/2202] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:48:59 2022] DELETE /identity/v3/users/6a932a53221e4c8ca6d833bf8b25148c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:00.137576 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-923c20c2-91bb-42d8-8814-4cd5daa4db65 None None] MFA Rules not processed for user `d5ad99e2ec6c42b2b48461fcb3416f32`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:00.139000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-923c20c2-91bb-42d8-8814-4cd5daa4db65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:00.228633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1103/2203] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:00.240548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:00.243533 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:00.363837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0a023-f65a-4e88-8075-1e8844dbe309 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:00.364558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0a023-f65a-4e88-8075-1e8844dbe309 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:00.364668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0a023-f65a-4e88-8075-1e8844dbe309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:00.377936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfba93-ffb3-45f5-8f45-f751500e9af0 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:00.384788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc760526-28f9-47c2-a55b-80a8a383e567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:00.385616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc760526-28f9-47c2-a55b-80a8a383e567 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:00.386110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc760526-28f9-47c2-a55b-80a8a383e567 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:00.386601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc760526-28f9-47c2-a55b-80a8a383e567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:00.403673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc760526-28f9-47c2-a55b-80a8a383e567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:00.407409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc760526-28f9-47c2-a55b-80a8a383e567 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:00.423822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1101/2204] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:00.424480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a2e0a023-f65a-4e88-8075-1e8844dbe309 None None] MFA Rules not processed for user `a5399e7179fe43a1826473d83e8e5c16`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:00.429087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a2e0a023-f65a-4e88-8075-1e8844dbe309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:00.577164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1104/2205] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:00.795891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc760526-28f9-47c2-a55b-80a8a383e567 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:00.797347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fc760526-28f9-47c2-a55b-80a8a383e567 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:00.818690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:00.949647 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc760526-28f9-47c2-a55b-80a8a383e567 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:00.965267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:00.966126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:00.967049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:00.967554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] PATH_INFO: `/v3/projects/9ac175b7e6d746c897c114efbff27b4c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:00.969523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac175b7e6d746c897c114efbff27b4c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:00.972278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:01.057285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac175b7e6d746c897c114efbff27b4c', 'request_id': 'req-ba909628-3cf0-4748-aed3-0f68f307caed'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.071517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac175b7e6d746c897c114efbff27b4c', 'request_id': 'req-ba909628-3cf0-4748-aed3-0f68f307caed'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.083955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac175b7e6d746c897c114efbff27b4c', 'request_id': 'req-ba909628-3cf0-4748-aed3-0f68f307caed'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.110833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] The token cache is being invalidate because project 9ac175b7e6d746c897c114efbff27b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:01.111768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.112756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba909628-3cf0-4748-aed3-0f68f307caed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.116788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1102/2206] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:00 2022] DELETE /identity/v3/projects/9ac175b7e6d746c897c114efbff27b4c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:01.124021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb133e-9a7f-49d5-b3e2-7c262b60a45a None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:01.124564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb133e-9a7f-49d5-b3e2-7c262b60a45a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:01.124754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb133e-9a7f-49d5-b3e2-7c262b60a45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:01.176970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b4eb133e-9a7f-49d5-b3e2-7c262b60a45a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:01.178460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b4eb133e-9a7f-49d5-b3e2-7c262b60a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:01.185787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:01.338731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1105/2207] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:01.348306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6242c-46e5-4118-8a88-e6dd1eb2dbcb None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:01.348965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6242c-46e5-4118-8a88-e6dd1eb2dbcb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:01.348965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6242c-46e5-4118-8a88-e6dd1eb2dbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:01.396005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-82c6242c-46e5-4118-8a88-e6dd1eb2dbcb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:01.399667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-82c6242c-46e5-4118-8a88-e6dd1eb2dbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:01.420835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1103/2208] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:01.425431 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb133e-9a7f-49d5-b3e2-7c262b60a45a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:01.440220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb133e-9a7f-49d5-b3e2-7c262b60a45a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:01.454820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de370ee-17a1-4545-b341-7c3b8282dcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:01.455485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de370ee-17a1-4545-b341-7c3b8282dcea admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:01.459121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de370ee-17a1-4545-b341-7c3b8282dcea admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:01.459121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de370ee-17a1-4545-b341-7c3b8282dcea admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:01.459845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de370ee-17a1-4545-b341-7c3b8282dcea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:01.460164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de370ee-17a1-4545-b341-7c3b8282dcea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:01.465026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de370ee-17a1-4545-b341-7c3b8282dcea admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:01.499386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6242c-46e5-4118-8a88-e6dd1eb2dbcb None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:01.502117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-82c6242c-46e5-4118-8a88-e6dd1eb2dbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:01.526488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1106/2209] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:01.528359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6242c-46e5-4118-8a88-e6dd1eb2dbcb None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:01.530695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de370ee-17a1-4545-b341-7c3b8282dcea admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:01.546830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:01.548100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:01.548394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:01.548672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] PATH_INFO: `/v3/users/be6539dbf4dd41e28da52d671d7eedb4` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:01.551502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6539dbf4dd41e28da52d671d7eedb4)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:01.553492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:01.558731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de370ee-17a1-4545-b341-7c3b8282dcea admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:01.578478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ff14-055a-462a-be50-08bb534be80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:01.579137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ff14-055a-462a-be50-08bb534be80f admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:01.579442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ff14-055a-462a-be50-08bb534be80f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:01.579715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ff14-055a-462a-be50-08bb534be80f admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:01.580633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455ff14-055a-462a-be50-08bb534be80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:01.582689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455ff14-055a-462a-be50-08bb534be80f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:01.657271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1107/2210] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:01 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:01.661046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ff14-055a-462a-be50-08bb534be80f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:01.780773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6539dbf4dd41e28da52d671d7eedb4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.798473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6539dbf4dd41e28da52d671d7eedb4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.811746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6539dbf4dd41e28da52d671d7eedb4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.833705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6539dbf4dd41e28da52d671d7eedb4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.834286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-5aa158d1-8adc-4896-a059-e1318fb1b7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6539dbf4dd41e28da52d671d7eedb4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:01.844041 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1104/2211] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:01 2022] DELETE /identity/v3/users/be6539dbf4dd41e28da52d671d7eedb4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:01.849536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e299-74b5-4ee4-b41c-0ec1f8e08349 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:01.849812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e299-74b5-4ee4-b41c-0ec1f8e08349 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:01.850049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e299-74b5-4ee4-b41c-0ec1f8e08349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:01.862582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:01.875114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ff14-055a-462a-be50-08bb534be80f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:01.877949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a913e299-74b5-4ee4-b41c-0ec1f8e08349 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:01.879998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a913e299-74b5-4ee4-b41c-0ec1f8e08349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:01.979301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1105/2212] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:02.001541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e4f6e-68f9-4bbb-b1c4-f8195c74a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.002372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e4f6e-68f9-4bbb-b1c4-f8195c74a951 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.002713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e4f6e-68f9-4bbb-b1c4-f8195c74a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.002984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e4f6e-68f9-4bbb-b1c4-f8195c74a951 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.003864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e4f6e-68f9-4bbb-b1c4-f8195c74a951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.006302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e4f6e-68f9-4bbb-b1c4-f8195c74a951 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.018838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913e299-74b5-4ee4-b41c-0ec1f8e08349 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.020944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a913e299-74b5-4ee4-b41c-0ec1f8e08349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:02.049535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1108/2213] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:01 2022] POST /identity/v3/users => generated 283 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:02.051245 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e4f6e-68f9-4bbb-b1c4-f8195c74a951 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.053122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c34e4f6e-68f9-4bbb-b1c4-f8195c74a951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:02.079933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e4f6e-68f9-4bbb-b1c4-f8195c74a951 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.086108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a71b0-abe8-4772-a186-d374a5f01eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.087210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a71b0-abe8-4772-a186-d374a5f01eab admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.087510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a71b0-abe8-4772-a186-d374a5f01eab admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.087824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a71b0-abe8-4772-a186-d374a5f01eab admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.088698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a71b0-abe8-4772-a186-d374a5f01eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.090415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a71b0-abe8-4772-a186-d374a5f01eab admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.097018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:02.107222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1109/2214] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:02.110969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a71b0-abe8-4772-a186-d374a5f01eab admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.121762 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a71b0-abe8-4772-a186-d374a5f01eab admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.126921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582e7ad-b93e-4db0-94e8-613928f7e3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.127735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582e7ad-b93e-4db0-94e8-613928f7e3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.128251 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582e7ad-b93e-4db0-94e8-613928f7e3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.128596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582e7ad-b93e-4db0-94e8-613928f7e3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.129735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582e7ad-b93e-4db0-94e8-613928f7e3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.131687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582e7ad-b93e-4db0-94e8-613928f7e3e4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.136341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913e299-74b5-4ee4-b41c-0ec1f8e08349 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.140746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61b716-435c-4c43-a64a-e654b814d82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.141372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b716-435c-4c43-a64a-e654b814d82d service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.142156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b716-435c-4c43-a64a-e654b814d82d service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.142156 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b716-435c-4c43-a64a-e654b814d82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.147392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1110/2215] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:02.153097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582e7ad-b93e-4db0-94e8-613928f7e3e4 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.162755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b716-435c-4c43-a64a-e654b814d82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.167370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b716-435c-4c43-a64a-e654b814d82d service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.180371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582e7ad-b93e-4db0-94e8-613928f7e3e4 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.191214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1106/2216] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:02.193236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f378-cc57-4638-9211-49573332da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.193955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f378-cc57-4638-9211-49573332da12 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.194247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f378-cc57-4638-9211-49573332da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.195505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f378-cc57-4638-9211-49573332da12 admin admin] PATH_INFO: `/v3/projects/6898686d72fe497099a37910acb157d4/users/ef5f1e277dc24e3092083f9b40e7be4b/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.217530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602f378-cc57-4638-9211-49573332da12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6898686d72fe497099a37910acb157d4, user_id=ef5f1e277dc24e3092083f9b40e7be4b, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.220338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602f378-cc57-4638-9211-49573332da12 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.279865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1111/2217] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:02 2022] PUT /identity/v3/projects/6898686d72fe497099a37910acb157d4/users/ef5f1e277dc24e3092083f9b40e7be4b/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:02.281917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180445f6-b77e-48e5-b18c-6f5bcfd9d9cf None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.283262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180445f6-b77e-48e5-b18c-6f5bcfd9d9cf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.283583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180445f6-b77e-48e5-b18c-6f5bcfd9d9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.320694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-180445f6-b77e-48e5-b18c-6f5bcfd9d9cf None None] MFA Rules not processed for user `ef5f1e277dc24e3092083f9b40e7be4b`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:02.322033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-180445f6-b77e-48e5-b18c-6f5bcfd9d9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:02.413635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1107/2218] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:02.415123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f378-cc57-4638-9211-49573332da12 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.507126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f378-cc57-4638-9211-49573332da12 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.513211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459076ab-502f-4827-9263-e9c47f22eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.513984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459076ab-502f-4827-9263-e9c47f22eb10 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.515782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459076ab-502f-4827-9263-e9c47f22eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.515782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459076ab-502f-4827-9263-e9c47f22eb10 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.515782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459076ab-502f-4827-9263-e9c47f22eb10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.519804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459076ab-502f-4827-9263-e9c47f22eb10 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.547306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1112/2219] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:02 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:02.551119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180445f6-b77e-48e5-b18c-6f5bcfd9d9cf None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.560261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459076ab-502f-4827-9263-e9c47f22eb10 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.563819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-459076ab-502f-4827-9263-e9c47f22eb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:02.565344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180445f6-b77e-48e5-b18c-6f5bcfd9d9cf None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.619632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:02.638303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459076ab-502f-4827-9263-e9c47f22eb10 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.643927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.644743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.644920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.645182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] PATH_INFO: `/v3/projects/6f21b88ef5ea4880a8ac84f9c99299ed` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.646389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f21b88ef5ea4880a8ac84f9c99299ed)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.648203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bc554-b35b-4751-b1c8-26f3e39887ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.648462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.648968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bc554-b35b-4751-b1c8-26f3e39887ba admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.649325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bc554-b35b-4751-b1c8-26f3e39887ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.649653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bc554-b35b-4751-b1c8-26f3e39887ba admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.650342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bc554-b35b-4751-b1c8-26f3e39887ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.652404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bc554-b35b-4751-b1c8-26f3e39887ba admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.679204 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1108/2220] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:02 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:02.683777 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bc554-b35b-4751-b1c8-26f3e39887ba admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.701736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bc554-b35b-4751-b1c8-26f3e39887ba admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.710520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103019-c669-41ab-9137-93245197e399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.711579 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103019-c669-41ab-9137-93245197e399 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.711910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103019-c669-41ab-9137-93245197e399 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.712343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103019-c669-41ab-9137-93245197e399 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.713153 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7103019-c669-41ab-9137-93245197e399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.715530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7103019-c669-41ab-9137-93245197e399 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.730023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1109/2221] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:02.734821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103019-c669-41ab-9137-93245197e399 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.736486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f21b88ef5ea4880a8ac84f9c99299ed', 'request_id': 'req-aaa4bc59-ed3c-428b-891d-f56943d4e253'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:02.744450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:02.747282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103019-c669-41ab-9137-93245197e399 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.751409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f21b88ef5ea4880a8ac84f9c99299ed', 'request_id': 'req-aaa4bc59-ed3c-428b-891d-f56943d4e253'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:02.763623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f21b88ef5ea4880a8ac84f9c99299ed', 'request_id': 'req-aaa4bc59-ed3c-428b-891d-f56943d4e253'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:02.779217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] The token cache is being invalidate because project 6f21b88ef5ea4880a8ac84f9c99299ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:02.779536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:02.780334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:02.781984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1113/2222] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:02 2022] DELETE /identity/v3/projects/6f21b88ef5ea4880a8ac84f9c99299ed => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:02.786674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.789832 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:02.834939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3045f-9d14-47d4-b122-9115a3b04974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.836104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3045f-9d14-47d4-b122-9115a3b04974 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.836510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3045f-9d14-47d4-b122-9115a3b04974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.836798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3045f-9d14-47d4-b122-9115a3b04974 admin admin] PATH_INFO: `/v3/projects/e632ca74977044bab0d550a1891cbeb7/users/070bcf520a464e00aae66b34f12ea7f6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.863731 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3045f-9d14-47d4-b122-9115a3b04974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e632ca74977044bab0d550a1891cbeb7, user_id=070bcf520a464e00aae66b34f12ea7f6, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.866423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3045f-9d14-47d4-b122-9115a3b04974 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.876444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bc59-ed3c-428b-891d-f56943d4e253 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.890838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1110/2223] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:02 2022] PUT /identity/v3/projects/e632ca74977044bab0d550a1891cbeb7/users/070bcf520a464e00aae66b34f12ea7f6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:02.894440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3045f-9d14-47d4-b122-9115a3b04974 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:02.896941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-67e3045f-9d14-47d4-b122-9115a3b04974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:02.946391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.947068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.947351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.947626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] PATH_INFO: `/v3/users/d5ad99e2ec6c42b2b48461fcb3416f32` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.949359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ad99e2ec6c42b2b48461fcb3416f32)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.951355 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:02.969759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3045f-9d14-47d4-b122-9115a3b04974 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:02.974730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b860d-1dd1-4d6e-9fd1-195c63635a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:02.976754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b860d-1dd1-4d6e-9fd1-195c63635a8e admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:02.977364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b860d-1dd1-4d6e-9fd1-195c63635a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:02.977980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b860d-1dd1-4d6e-9fd1-195c63635a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:02.979089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b860d-1dd1-4d6e-9fd1-195c63635a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:02.982172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b860d-1dd1-4d6e-9fd1-195c63635a8e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:03.002807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1111/2224] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:03.007351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b860d-1dd1-4d6e-9fd1-195c63635a8e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:03.007833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ad99e2ec6c42b2b48461fcb3416f32'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.008790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ad99e2ec6c42b2b48461fcb3416f32'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.024135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b860d-1dd1-4d6e-9fd1-195c63635a8e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:03.024600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ad99e2ec6c42b2b48461fcb3416f32'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.030019 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255e4a-34a4-4363-9444-19da92b64548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:03.030690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255e4a-34a4-4363-9444-19da92b64548 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.031060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255e4a-34a4-4363-9444-19da92b64548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.031331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255e4a-34a4-4363-9444-19da92b64548 admin admin] PATH_INFO: `/v3/projects/e632ca74977044bab0d550a1891cbeb7/users/070bcf520a464e00aae66b34f12ea7f6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.033364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c255e4a-34a4-4363-9444-19da92b64548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e632ca74977044bab0d550a1891cbeb7, user_id=070bcf520a464e00aae66b34f12ea7f6, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:03.033818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ad99e2ec6c42b2b48461fcb3416f32'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.034697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ad99e2ec6c42b2b48461fcb3416f32'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.036164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c255e4a-34a4-4363-9444-19da92b64548 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:03.047311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1112/2225] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:03 2022] PUT /identity/v3/projects/e632ca74977044bab0d550a1891cbeb7/users/070bcf520a464e00aae66b34f12ea7f6/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:03.056448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1114/2226] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:02 2022] DELETE /identity/v3/users/d5ad99e2ec6c42b2b48461fcb3416f32 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:03.058360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43696aae-b77a-4ea5-a97f-8cca4234002d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.058654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43696aae-b77a-4ea5-a97f-8cca4234002d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.059060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43696aae-b77a-4ea5-a97f-8cca4234002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.093637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-43696aae-b77a-4ea5-a97f-8cca4234002d None None] MFA Rules not processed for user `070bcf520a464e00aae66b34f12ea7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:03.095091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-43696aae-b77a-4ea5-a97f-8cca4234002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:03.122442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:03.203766 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1113/2227] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:03.217092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:03.219167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:03.232358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:03.323503 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb38235-c937-4376-88b1-e6b598f139dd admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:03.329042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf57bc-e62e-4528-98e4-c4134adfdfad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:03.329962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf57bc-e62e-4528-98e4-c4134adfdfad service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.330401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf57bc-e62e-4528-98e4-c4134adfdfad service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.330743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf57bc-e62e-4528-98e4-c4134adfdfad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.342066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf57bc-e62e-4528-98e4-c4134adfdfad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:03.343846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf57bc-e62e-4528-98e4-c4134adfdfad service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:03.357497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1115/2228] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:03.447422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43696aae-b77a-4ea5-a97f-8cca4234002d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:03.449464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-43696aae-b77a-4ea5-a97f-8cca4234002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:03.469475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf57bc-e62e-4528-98e4-c4134adfdfad service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:03.486962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf57bc-e62e-4528-98e4-c4134adfdfad service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:03.496671 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d523e2f-5243-4d39-b2c2-e8a97aaf68c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:03.497287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d523e2f-5243-4d39-b2c2-e8a97aaf68c7 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.497681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d523e2f-5243-4d39-b2c2-e8a97aaf68c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.497852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d523e2f-5243-4d39-b2c2-e8a97aaf68c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.500131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5d523e2f-5243-4d39-b2c2-e8a97aaf68c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:03.557706 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43696aae-b77a-4ea5-a97f-8cca4234002d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:03.562588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:03.563399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.563751 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.564172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] PATH_INFO: `/v3/projects/202f7a3b3fec4074848a30d9acaee962` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.565426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=202f7a3b3fec4074848a30d9acaee962)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:03.567598 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:03.582341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d523e2f-5243-4d39-b2c2-e8a97aaf68c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:03.583810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d523e2f-5243-4d39-b2c2-e8a97aaf68c7 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:03.594056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1116/2229] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:49:03.621574 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202f7a3b3fec4074848a30d9acaee962', 'request_id': 'req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.628370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202f7a3b3fec4074848a30d9acaee962', 'request_id': 'req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.637279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202f7a3b3fec4074848a30d9acaee962', 'request_id': 'req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.649257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] The token cache is being invalidate because project 202f7a3b3fec4074848a30d9acaee962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:03.649797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.650481 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-446b3ca8-a5e9-43ea-aa83-453b9d2adf72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:03.652151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1114/2230] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:03 2022] DELETE /identity/v3/projects/202f7a3b3fec4074848a30d9acaee962 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:03.657124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025175b-2a01-430a-b541-54d4ac409f59 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.657408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025175b-2a01-430a-b541-54d4ac409f59 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.657677 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025175b-2a01-430a-b541-54d4ac409f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.677443 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-4025175b-2a01-430a-b541-54d4ac409f59 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:03.678651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4025175b-2a01-430a-b541-54d4ac409f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:03.749082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1117/2231] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:03.756839 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257b49-b227-427b-9713-fad871cab3ae None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.757211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257b49-b227-427b-9713-fad871cab3ae None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.757430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257b49-b227-427b-9713-fad871cab3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.778801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-70257b49-b227-427b-9713-fad871cab3ae None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:03.779996 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-70257b49-b227-427b-9713-fad871cab3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:03.787887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1115/2232] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:03.792866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025175b-2a01-430a-b541-54d4ac409f59 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:03.802493 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025175b-2a01-430a-b541-54d4ac409f59 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:03.812577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547d803-5d50-43a5-bc50-ddfc95c2756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:03.813401 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547d803-5d50-43a5-bc50-ddfc95c2756b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.813752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547d803-5d50-43a5-bc50-ddfc95c2756b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.814093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547d803-5d50-43a5-bc50-ddfc95c2756b admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.816627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547d803-5d50-43a5-bc50-ddfc95c2756b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:03.816627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547d803-5d50-43a5-bc50-ddfc95c2756b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:03.818803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547d803-5d50-43a5-bc50-ddfc95c2756b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:03.837107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1118/2233] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:03.838783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70257b49-b227-427b-9713-fad871cab3ae None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:03.852276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70257b49-b227-427b-9713-fad871cab3ae None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:03.857742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a87827-2645-4419-a1f2-9b49367b8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:03.858469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87827-2645-4419-a1f2-9b49367b8336 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.858805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87827-2645-4419-a1f2-9b49367b8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.859134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87827-2645-4419-a1f2-9b49367b8336 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.859830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a87827-2645-4419-a1f2-9b49367b8336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:03.861936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a87827-2645-4419-a1f2-9b49367b8336 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:03.908306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1116/2234] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:03 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:03.912421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547d803-5d50-43a5-bc50-ddfc95c2756b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:03.924448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547d803-5d50-43a5-bc50-ddfc95c2756b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:03.960034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:03.989335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcd755-2acf-4e79-84bf-db96e5ee089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:03.990043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcd755-2acf-4e79-84bf-db96e5ee089c admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:03.990206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcd755-2acf-4e79-84bf-db96e5ee089c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:03.990471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcd755-2acf-4e79-84bf-db96e5ee089c admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:03.991132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcd755-2acf-4e79-84bf-db96e5ee089c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:03.993370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcd755-2acf-4e79-84bf-db96e5ee089c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.019629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1119/2235] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:03 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:04.019950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a87827-2645-4419-a1f2-9b49367b8336 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:04.030837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a87827-2645-4419-a1f2-9b49367b8336 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:04.036048 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17627746-20e6-42c8-9852-a2e7c2b5c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:04.036725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627746-20e6-42c8-9852-a2e7c2b5c547 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.037011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627746-20e6-42c8-9852-a2e7c2b5c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.037286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627746-20e6-42c8-9852-a2e7c2b5c547 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.037932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17627746-20e6-42c8-9852-a2e7c2b5c547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:04.040599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17627746-20e6-42c8-9852-a2e7c2b5c547 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.042988 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:04.052514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1117/2236] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:04.056384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcd755-2acf-4e79-84bf-db96e5ee089c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:04.066797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcd755-2acf-4e79-84bf-db96e5ee089c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:04.072639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4e565-9f65-4439-b503-ac33ec5dee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:04.073256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4e565-9f65-4439-b503-ac33ec5dee38 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.073538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4e565-9f65-4439-b503-ac33ec5dee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.073814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4e565-9f65-4439-b503-ac33ec5dee38 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.074499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4e565-9f65-4439-b503-ac33ec5dee38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:04.076239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4e565-9f65-4439-b503-ac33ec5dee38 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.088593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1120/2237] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:04.093271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17627746-20e6-42c8-9852-a2e7c2b5c547 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:04.105964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17627746-20e6-42c8-9852-a2e7c2b5c547 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:04.111590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c5232-adf0-4036-9ec0-2563c8d90d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:04.112338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c5232-adf0-4036-9ec0-2563c8d90d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.112749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c5232-adf0-4036-9ec0-2563c8d90d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.113114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c5232-adf0-4036-9ec0-2563c8d90d9f admin admin] PATH_INFO: `/v3/projects/5f7bb1f13fcd403ea74779d9f9b84d21/users/45a7c0846bcf47e5aa0eee1bffae7ea6/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.129499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c5232-adf0-4036-9ec0-2563c8d90d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7bb1f13fcd403ea74779d9f9b84d21, user_id=45a7c0846bcf47e5aa0eee1bffae7ea6, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:04.132277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c5232-adf0-4036-9ec0-2563c8d90d9f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.146779 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1118/2238] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:04 2022] PUT /identity/v3/projects/5f7bb1f13fcd403ea74779d9f9b84d21/users/45a7c0846bcf47e5aa0eee1bffae7ea6/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:04.158201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489a094-c425-42ec-b358-aad208850649 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.158567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489a094-c425-42ec-b358-aad208850649 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.158891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489a094-c425-42ec-b358-aad208850649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.189128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f489a094-c425-42ec-b358-aad208850649 None None] MFA Rules not processed for user `45a7c0846bcf47e5aa0eee1bffae7ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:04.190351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f489a094-c425-42ec-b358-aad208850649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:04.276408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1121/2239] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:04.278086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c5232-adf0-4036-9ec0-2563c8d90d9f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:04.356247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c5232-adf0-4036-9ec0-2563c8d90d9f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:04.361629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2d2b-8d96-4ada-9992-09f4085d8b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:04.362235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2d2b-8d96-4ada-9992-09f4085d8b82 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.362541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2d2b-8d96-4ada-9992-09f4085d8b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.362861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2d2b-8d96-4ada-9992-09f4085d8b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.363579 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e2d2b-8d96-4ada-9992-09f4085d8b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:04.365676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e2d2b-8d96-4ada-9992-09f4085d8b82 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.394008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1119/2240] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:04 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:04.398753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489a094-c425-42ec-b358-aad208850649 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:04.409934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489a094-c425-42ec-b358-aad208850649 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:04.470515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0df0f-4d86-4e1a-a4fa-85b0c10a4c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:04.471183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0df0f-4d86-4e1a-a4fa-85b0c10a4c1f admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.471484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0df0f-4d86-4e1a-a4fa-85b0c10a4c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.471813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0df0f-4d86-4e1a-a4fa-85b0c10a4c1f admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.472612 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0df0f-4d86-4e1a-a4fa-85b0c10a4c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:04.474444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0df0f-4d86-4e1a-a4fa-85b0c10a4c1f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.501783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1122/2241] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:04 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:04.503099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2d2b-8d96-4ada-9992-09f4085d8b82 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:04.513977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2d2b-8d96-4ada-9992-09f4085d8b82 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:04.518997 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f309f-501b-40bf-8515-4b1fe211420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:04.519697 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f309f-501b-40bf-8515-4b1fe211420f admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.520036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f309f-501b-40bf-8515-4b1fe211420f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.520377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f309f-501b-40bf-8515-4b1fe211420f admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.521125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f309f-501b-40bf-8515-4b1fe211420f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:04.523322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f309f-501b-40bf-8515-4b1fe211420f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.535292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1120/2242] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:04.540704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0df0f-4d86-4e1a-a4fa-85b0c10a4c1f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:04.552871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0df0f-4d86-4e1a-a4fa-85b0c10a4c1f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:04.581555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d64b53-5169-4e3f-b719-09be0827fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:04.582349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d64b53-5169-4e3f-b719-09be0827fae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.582927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d64b53-5169-4e3f-b719-09be0827fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.583088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d64b53-5169-4e3f-b719-09be0827fae5 admin admin] PATH_INFO: `/v3/projects/c8fcd9491cb04fb6856863801ed012c2/users/7f5cd002962e4f5d8089511ace9fa682/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.636208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d64b53-5169-4e3f-b719-09be0827fae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fcd9491cb04fb6856863801ed012c2, user_id=7f5cd002962e4f5d8089511ace9fa682, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:04.639114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d64b53-5169-4e3f-b719-09be0827fae5 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.657843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1123/2243] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:04 2022] PUT /identity/v3/projects/c8fcd9491cb04fb6856863801ed012c2/users/7f5cd002962e4f5d8089511ace9fa682/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:04.661805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f309f-501b-40bf-8515-4b1fe211420f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:04.677002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f309f-501b-40bf-8515-4b1fe211420f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:04.749310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9243c-5b30-45e3-935b-b9fa3f2bf084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:04.750730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9243c-5b30-45e3-935b-b9fa3f2bf084 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.751149 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9243c-5b30-45e3-935b-b9fa3f2bf084 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.751521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9243c-5b30-45e3-935b-b9fa3f2bf084 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.752958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9243c-5b30-45e3-935b-b9fa3f2bf084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:04.755035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9243c-5b30-45e3-935b-b9fa3f2bf084 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.771947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1121/2244] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:04.777647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d64b53-5169-4e3f-b719-09be0827fae5 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:04.815141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d64b53-5169-4e3f-b719-09be0827fae5 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:04.822475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2ffd9-a296-4c7f-8614-cb24e39cfc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:04.823640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2ffd9-a296-4c7f-8614-cb24e39cfc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.825015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2ffd9-a296-4c7f-8614-cb24e39cfc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.825736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2ffd9-a296-4c7f-8614-cb24e39cfc05 admin admin] PATH_INFO: `/v3/projects/c8fcd9491cb04fb6856863801ed012c2/users/7f5cd002962e4f5d8089511ace9fa682/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.828032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2ffd9-a296-4c7f-8614-cb24e39cfc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fcd9491cb04fb6856863801ed012c2, user_id=7f5cd002962e4f5d8089511ace9fa682, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:04.833942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2ffd9-a296-4c7f-8614-cb24e39cfc05 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:04.839569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:04.855541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1124/2245] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:04 2022] PUT /identity/v3/projects/c8fcd9491cb04fb6856863801ed012c2/users/7f5cd002962e4f5d8089511ace9fa682/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:04.873314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193e3a4-290b-4710-ab95-f0700d6419ac None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:04.873859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193e3a4-290b-4710-ab95-f0700d6419ac None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:04.873859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193e3a4-290b-4710-ab95-f0700d6419ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:04.942543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c193e3a4-290b-4710-ab95-f0700d6419ac None None] MFA Rules not processed for user `7f5cd002962e4f5d8089511ace9fa682`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:04.943641 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c193e3a4-290b-4710-ab95-f0700d6419ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:05.014982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:05.077017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1122/2246] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:05.085730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2ffd9-a296-4c7f-8614-cb24e39cfc05 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:05.088868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d1f2ffd9-a296-4c7f-8614-cb24e39cfc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:05.226666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2ffd9-a296-4c7f-8614-cb24e39cfc05 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:05.235739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f31b0-d1aa-4074-89a0-0bfdd35bf353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:05.238924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f31b0-d1aa-4074-89a0-0bfdd35bf353 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:05.239217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f31b0-d1aa-4074-89a0-0bfdd35bf353 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:05.239556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f31b0-d1aa-4074-89a0-0bfdd35bf353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:05.270721 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f31b0-d1aa-4074-89a0-0bfdd35bf353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:05.275388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f31b0-d1aa-4074-89a0-0bfdd35bf353 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:05.290905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1125/2247] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:49:06.244250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193e3a4-290b-4710-ab95-f0700d6419ac None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:06.330245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193e3a4-290b-4710-ab95-f0700d6419ac None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:06.335140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:06.336541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:06.336772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:06.337828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] PATH_INFO: `/v3/users/45a7c0846bcf47e5aa0eee1bffae7ea6` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:06.339334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a7c0846bcf47e5aa0eee1bffae7ea6)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:06.341661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:06.427814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a7c0846bcf47e5aa0eee1bffae7ea6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:06.443608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a7c0846bcf47e5aa0eee1bffae7ea6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:06.452673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a7c0846bcf47e5aa0eee1bffae7ea6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:06.470101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a7c0846bcf47e5aa0eee1bffae7ea6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:06.470960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a7c0846bcf47e5aa0eee1bffae7ea6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:06.478694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1123/2248] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:06 2022] DELETE /identity/v3/users/45a7c0846bcf47e5aa0eee1bffae7ea6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:06.484127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5578cc0-0b45-43a8-944a-3a9f2cac37ea None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:06.484575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5578cc0-0b45-43a8-944a-3a9f2cac37ea None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:06.484702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5578cc0-0b45-43a8-944a-3a9f2cac37ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:06.530857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c5578cc0-0b45-43a8-944a-3a9f2cac37ea None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:06.533663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c5578cc0-0b45-43a8-944a-3a9f2cac37ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:06.659501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1126/2249] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:06.668302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:06.669972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:06.744719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:06.747937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308de4-fb18-441c-9685-f20e9784f7ee admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:06.752626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c9aad-1ce7-4ee1-a221-b193e927344d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:06.753431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9aad-1ce7-4ee1-a221-b193e927344d service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:06.753860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9aad-1ce7-4ee1-a221-b193e927344d service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:06.754721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9aad-1ce7-4ee1-a221-b193e927344d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:06.779679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c9aad-1ce7-4ee1-a221-b193e927344d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:06.781159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c9aad-1ce7-4ee1-a221-b193e927344d service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:06.808477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1124/2250] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:07.328339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5578cc0-0b45-43a8-944a-3a9f2cac37ea None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:07.330087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c5578cc0-0b45-43a8-944a-3a9f2cac37ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:07.356212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5578cc0-0b45-43a8-944a-3a9f2cac37ea None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:07.370691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:07.371547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:07.371919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:07.372408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] PATH_INFO: `/v3/projects/5f7bb1f13fcd403ea74779d9f9b84d21` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:07.374255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7bb1f13fcd403ea74779d9f9b84d21)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:07.379896 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:07.506291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7bb1f13fcd403ea74779d9f9b84d21', 'request_id': 'req-7f2b55cf-63f3-4f71-9773-d2c68a952448'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.515699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7bb1f13fcd403ea74779d9f9b84d21', 'request_id': 'req-7f2b55cf-63f3-4f71-9773-d2c68a952448'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.537659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7bb1f13fcd403ea74779d9f9b84d21', 'request_id': 'req-7f2b55cf-63f3-4f71-9773-d2c68a952448'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.565435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] The token cache is being invalidate because project 5f7bb1f13fcd403ea74779d9f9b84d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:07.566098 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.567262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.573936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1127/2251] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:07 2022] DELETE /identity/v3/projects/5f7bb1f13fcd403ea74779d9f9b84d21 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:07.578234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c9aad-1ce7-4ee1-a221-b193e927344d service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:07.605746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c9aad-1ce7-4ee1-a221-b193e927344d service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:07.698071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:07.699166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:07.699705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:07.700220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] PATH_INFO: `/v3/users/7f5cd002962e4f5d8089511ace9fa682` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:07.702472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5cd002962e4f5d8089511ace9fa682)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:07.704880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:07.806171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5cd002962e4f5d8089511ace9fa682'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.818064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5cd002962e4f5d8089511ace9fa682'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.830649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5cd002962e4f5d8089511ace9fa682'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.862916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5cd002962e4f5d8089511ace9fa682'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.866711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ea57a9cc-f723-4746-a8e0-85fc03ccf58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5cd002962e4f5d8089511ace9fa682'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:07.878964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1125/2252] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:07 2022] DELETE /identity/v3/users/7f5cd002962e4f5d8089511ace9fa682 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:08.202327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:08.203957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:08.217604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b55cf-63f3-4f71-9773-d2c68a952448 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:08.237679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:08.284892 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:08.285533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.285808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.286077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] PATH_INFO: `/v3/users/1184f47cf81a46658d47578e3776b211` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.287245 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1184f47cf81a46658d47578e3776b211)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:08.290027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:08.340011 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1184f47cf81a46658d47578e3776b211'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.340976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1184f47cf81a46658d47578e3776b211'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.355924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1184f47cf81a46658d47578e3776b211'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.363834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1184f47cf81a46658d47578e3776b211'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.364609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1184f47cf81a46658d47578e3776b211'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.381394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1128/2253] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:08 2022] DELETE /identity/v3/users/1184f47cf81a46658d47578e3776b211 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:08.386596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6d9e0-790b-4946-bbdc-9815c28e172e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.386942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6d9e0-790b-4946-bbdc-9815c28e172e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.387312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6d9e0-790b-4946-bbdc-9815c28e172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.396249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:08.398359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:08.421148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4ce6d9e0-790b-4946-bbdc-9815c28e172e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:08.433315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4ce6d9e0-790b-4946-bbdc-9815c28e172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:08.474930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b997fc-0e81-4084-8eb1-0696e1b7c159 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:08.488154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:08.488820 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.489117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.489374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] PATH_INFO: `/v3/projects/c8fcd9491cb04fb6856863801ed012c2` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.493179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fcd9491cb04fb6856863801ed012c2)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:08.495854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:08.512929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1126/2254] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:08.525448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6d9e0-790b-4946-bbdc-9815c28e172e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:08.527797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4ce6d9e0-790b-4946-bbdc-9815c28e172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:08.545547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:08.562443 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:08.566346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fcd9491cb04fb6856863801ed012c2', 'request_id': 'req-b11d9951-489d-4702-9b63-ae8294add43c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.573703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fcd9491cb04fb6856863801ed012c2', 'request_id': 'req-b11d9951-489d-4702-9b63-ae8294add43c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.585668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fcd9491cb04fb6856863801ed012c2', 'request_id': 'req-b11d9951-489d-4702-9b63-ae8294add43c'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.598303 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] The token cache is being invalidate because project c8fcd9491cb04fb6856863801ed012c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:08.599015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.599822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b11d9951-489d-4702-9b63-ae8294add43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:08.601936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1129/2255] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:08 2022] DELETE /identity/v3/projects/c8fcd9491cb04fb6856863801ed012c2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:08.606935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fe313-82db-43d1-8055-a229b619c522 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.607221 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fe313-82db-43d1-8055-a229b619c522 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.607589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fe313-82db-43d1-8055-a229b619c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.609208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6d9e0-790b-4946-bbdc-9815c28e172e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:08.627871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-813fe313-82db-43d1-8055-a229b619c522 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:08.629102 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-813fe313-82db-43d1-8055-a229b619c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:08.664916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27b91e-a169-4adf-96b3-b3ed21defddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:08.665525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27b91e-a169-4adf-96b3-b3ed21defddb service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.665802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27b91e-a169-4adf-96b3-b3ed21defddb service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.666075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27b91e-a169-4adf-96b3-b3ed21defddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.667980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9d27b91e-a169-4adf-96b3-b3ed21defddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:08.693115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1130/2256] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:08.700723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138fc65-f5af-4ab4-ab13-934ee54487d6 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.701065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138fc65-f5af-4ab4-ab13-934ee54487d6 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.701338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138fc65-f5af-4ab4-ab13-934ee54487d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.721083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-1138fc65-f5af-4ab4-ab13-934ee54487d6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:08.722299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1138fc65-f5af-4ab4-ab13-934ee54487d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:08.731753 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1131/2257] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:08.736349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27b91e-a169-4adf-96b3-b3ed21defddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:08.736632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138fc65-f5af-4ab4-ab13-934ee54487d6 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:08.737871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27b91e-a169-4adf-96b3-b3ed21defddb service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:08.749118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1127/2258] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:08.749418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138fc65-f5af-4ab4-ab13-934ee54487d6 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:08.754261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1af9-4ca9-4561-a054-15f0f4c2af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:08.754905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1af9-4ca9-4561-a054-15f0f4c2af6a admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.755245 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1af9-4ca9-4561-a054-15f0f4c2af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.755519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1af9-4ca9-4561-a054-15f0f4c2af6a admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.756171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1af9-4ca9-4561-a054-15f0f4c2af6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:08.756482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1af9-4ca9-4561-a054-15f0f4c2af6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:08.759046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1af9-4ca9-4561-a054-15f0f4c2af6a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:08.778229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1132/2259] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:08.779739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27b91e-a169-4adf-96b3-b3ed21defddb service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:08.794645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27b91e-a169-4adf-96b3-b3ed21defddb service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:08.799688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3915237-ce06-4d64-b17c-6192ffaaf3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:08.800310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3915237-ce06-4d64-b17c-6192ffaaf3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.800593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3915237-ce06-4d64-b17c-6192ffaaf3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.800904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3915237-ce06-4d64-b17c-6192ffaaf3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.801566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3915237-ce06-4d64-b17c-6192ffaaf3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:08.804865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3915237-ce06-4d64-b17c-6192ffaaf3f2 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:08.839327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1128/2260] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:08 2022] POST /identity/v3/projects => generated 359 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:08.841074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1af9-4ca9-4561-a054-15f0f4c2af6a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:08.853497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1af9-4ca9-4561-a054-15f0f4c2af6a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:08.922380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53826ac4-a3c5-4427-a2dd-ad8e9dbc8e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:08.923095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53826ac4-a3c5-4427-a2dd-ad8e9dbc8e24 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.923376 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53826ac4-a3c5-4427-a2dd-ad8e9dbc8e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.923647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53826ac4-a3c5-4427-a2dd-ad8e9dbc8e24 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.924279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53826ac4-a3c5-4427-a2dd-ad8e9dbc8e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:08.926225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53826ac4-a3c5-4427-a2dd-ad8e9dbc8e24 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:08.958100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1133/2261] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:08 2022] POST /identity/v3/users => generated 280 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:49:08.962069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3915237-ce06-4d64-b17c-6192ffaaf3f2 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:08.972654 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3915237-ce06-4d64-b17c-6192ffaaf3f2 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:08.978138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fda15-2361-4373-8935-c107b93f7bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:08.980331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fda15-2361-4373-8935-c107b93f7bfd admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:08.980331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fda15-2361-4373-8935-c107b93f7bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:08.980331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fda15-2361-4373-8935-c107b93f7bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:08.980331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fda15-2361-4373-8935-c107b93f7bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:08.990667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fda15-2361-4373-8935-c107b93f7bfd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:09.014827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1129/2262] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:09.018738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53826ac4-a3c5-4427-a2dd-ad8e9dbc8e24 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:09.033529 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53826ac4-a3c5-4427-a2dd-ad8e9dbc8e24 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:09.040454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e66718-560e-44eb-b6d7-2ee32245c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:09.041071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66718-560e-44eb-b6d7-2ee32245c8bd admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.041353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66718-560e-44eb-b6d7-2ee32245c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.042127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66718-560e-44eb-b6d7-2ee32245c8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.042435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e66718-560e-44eb-b6d7-2ee32245c8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:09.044636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e66718-560e-44eb-b6d7-2ee32245c8bd admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:09.077141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1134/2263] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:09.081159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fda15-2361-4373-8935-c107b93f7bfd admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:09.093624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fda15-2361-4373-8935-c107b93f7bfd admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:09.099663 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b4d88-f037-49c5-bb6d-4eaeac69d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:09.100428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b4d88-f037-49c5-bb6d-4eaeac69d6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.100747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b4d88-f037-49c5-bb6d-4eaeac69d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.101170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b4d88-f037-49c5-bb6d-4eaeac69d6c9 admin admin] PATH_INFO: `/v3/projects/fd1dac1f37234e35b8b479ac75d78e99/users/65c1277c67d04b869e6aaea1805c67f0/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.123281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b4d88-f037-49c5-bb6d-4eaeac69d6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1dac1f37234e35b8b479ac75d78e99, user_id=65c1277c67d04b869e6aaea1805c67f0, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:09.126588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b4d88-f037-49c5-bb6d-4eaeac69d6c9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:09.142810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1130/2264] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:09 2022] PUT /identity/v3/projects/fd1dac1f37234e35b8b479ac75d78e99/users/65c1277c67d04b869e6aaea1805c67f0/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:09.155847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eabad3-fc9a-452d-8751-fbea9be471aa None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.156415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eabad3-fc9a-452d-8751-fbea9be471aa None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.157003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eabad3-fc9a-452d-8751-fbea9be471aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.227188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-96eabad3-fc9a-452d-8751-fbea9be471aa None None] MFA Rules not processed for user `65c1277c67d04b869e6aaea1805c67f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:09.229148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-96eabad3-fc9a-452d-8751-fbea9be471aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:09.267260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:09.328986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1135/2265] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:09.335818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b4d88-f037-49c5-bb6d-4eaeac69d6c9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:09.339840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9a6b4d88-f037-49c5-bb6d-4eaeac69d6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:09.377359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eabad3-fc9a-452d-8751-fbea9be471aa None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:09.382956 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-96eabad3-fc9a-452d-8751-fbea9be471aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:09.425023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:09.498044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b4d88-f037-49c5-bb6d-4eaeac69d6c9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:09.506516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:09.507866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.508260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.508789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] PATH_INFO: `/v3/projects/d04e732b943f4853968b0f38403baea1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.509978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04e732b943f4853968b0f38403baea1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:09.513238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:09.525356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eabad3-fc9a-452d-8751-fbea9be471aa None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:09.539430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c10327-0aee-4cbe-a644-60ac577d4846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:09.540085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c10327-0aee-4cbe-a644-60ac577d4846 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.540556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c10327-0aee-4cbe-a644-60ac577d4846 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.541179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c10327-0aee-4cbe-a644-60ac577d4846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.567281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c10327-0aee-4cbe-a644-60ac577d4846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:09.568867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c10327-0aee-4cbe-a644-60ac577d4846 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:09.579818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1136/2266] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:09.593248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04e732b943f4853968b0f38403baea1', 'request_id': 'req-f4145014-3419-4a2f-8502-f3f958a5faf3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.598838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c10327-0aee-4cbe-a644-60ac577d4846 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:09.603085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04e732b943f4853968b0f38403baea1', 'request_id': 'req-f4145014-3419-4a2f-8502-f3f958a5faf3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.613510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04e732b943f4853968b0f38403baea1', 'request_id': 'req-f4145014-3419-4a2f-8502-f3f958a5faf3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.620756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c10327-0aee-4cbe-a644-60ac577d4846 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:09.643284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] The token cache is being invalidate because project d04e732b943f4853968b0f38403baea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:09.643580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.646108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f4145014-3419-4a2f-8502-f3f958a5faf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.649481 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1131/2267] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:09 2022] DELETE /identity/v3/projects/d04e732b943f4853968b0f38403baea1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:09.654502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2cbcc-31be-421c-94d6-4dc0c9e67bc6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.654814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2cbcc-31be-421c-94d6-4dc0c9e67bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.655889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2cbcc-31be-421c-94d6-4dc0c9e67bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.681250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2bc2cbcc-31be-421c-94d6-4dc0c9e67bc6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:09.682603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2bc2cbcc-31be-421c-94d6-4dc0c9e67bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:09.710855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:09.713361 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.713361 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.713361 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] PATH_INFO: `/v3/users/65c1277c67d04b869e6aaea1805c67f0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.714715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c1277c67d04b869e6aaea1805c67f0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:09.716839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:09.774723 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1132/2268] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:09.783815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6256755-2caf-4798-b7aa-c64dfee7abe6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.783815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6256755-2caf-4798-b7aa-c64dfee7abe6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.784082 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6256755-2caf-4798-b7aa-c64dfee7abe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.803716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c1277c67d04b869e6aaea1805c67f0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.805373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c1277c67d04b869e6aaea1805c67f0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.806843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f6256755-2caf-4798-b7aa-c64dfee7abe6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:09.808075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f6256755-2caf-4798-b7aa-c64dfee7abe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:09.818917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1133/2269] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:09.823504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6256755-2caf-4798-b7aa-c64dfee7abe6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:09.823786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c1277c67d04b869e6aaea1805c67f0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.825659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:09.833848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c1277c67d04b869e6aaea1805c67f0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.834577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-981fefee-3006-4409-a9c3-b94acbf8f828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c1277c67d04b869e6aaea1805c67f0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:09.835107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6256755-2caf-4798-b7aa-c64dfee7abe6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:09.840104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:09.840753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.841073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.841383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.842044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:09.842352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:09.844013 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:09.853096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1137/2270] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:09 2022] DELETE /identity/v3/users/65c1277c67d04b869e6aaea1805c67f0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:09.857473 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f31bd-dd51-42ce-ae96-e32dfad6823e None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.858368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f31bd-dd51-42ce-ae96-e32dfad6823e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.858644 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f31bd-dd51-42ce-ae96-e32dfad6823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.860829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1134/2271] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:09.865060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:09.869100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:09.887838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-052f31bd-dd51-42ce-ae96-e32dfad6823e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:09.889889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-052f31bd-dd51-42ce-ae96-e32dfad6823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:09.893903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdeae5-01e2-41a7-92ba-f32f23e69aa5 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:09.933158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:09.961948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1138/2272] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:09.971522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ccb76-56bc-4127-8254-012e66919987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:09.972059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f31bd-dd51-42ce-ae96-e32dfad6823e None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:09.972203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ccb76-56bc-4127-8254-012e66919987 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:09.972403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ccb76-56bc-4127-8254-012e66919987 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:09.972681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ccb76-56bc-4127-8254-012e66919987 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:09.973317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ccb76-56bc-4127-8254-012e66919987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:09.973856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-052f31bd-dd51-42ce-ae96-e32dfad6823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:09.975307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ccb76-56bc-4127-8254-012e66919987 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.007032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1135/2273] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:09 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:49:10.012729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ccb76-56bc-4127-8254-012e66919987 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.037784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f31bd-dd51-42ce-ae96-e32dfad6823e None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.087407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ccb76-56bc-4127-8254-012e66919987 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.092263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5337ce-80ad-4162-99c8-16c26d4445c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.092904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5337ce-80ad-4162-99c8-16c26d4445c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.093179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5337ce-80ad-4162-99c8-16c26d4445c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.093452 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5337ce-80ad-4162-99c8-16c26d4445c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.094073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5337ce-80ad-4162-99c8-16c26d4445c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.096229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5337ce-80ad-4162-99c8-16c26d4445c5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.098292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572df8-db76-4fc1-9b87-ab81ec651b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.099075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572df8-db76-4fc1-9b87-ab81ec651b3a service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.099488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572df8-db76-4fc1-9b87-ab81ec651b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.099767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572df8-db76-4fc1-9b87-ab81ec651b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.115520 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61572df8-db76-4fc1-9b87-ab81ec651b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.117902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61572df8-db76-4fc1-9b87-ab81ec651b3a service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.120258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1136/2274] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:10 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:10.125126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5337ce-80ad-4162-99c8-16c26d4445c5 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.129108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1139/2275] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:10.138983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5337ce-80ad-4162-99c8-16c26d4445c5 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.144517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f90eb-b694-47c1-8497-a0ad8664324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.145145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f90eb-b694-47c1-8497-a0ad8664324e admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.145426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f90eb-b694-47c1-8497-a0ad8664324e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.145703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f90eb-b694-47c1-8497-a0ad8664324e admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.146354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f90eb-b694-47c1-8497-a0ad8664324e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.149048 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f90eb-b694-47c1-8497-a0ad8664324e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.160280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1137/2276] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:10.165963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572df8-db76-4fc1-9b87-ab81ec651b3a service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.182015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572df8-db76-4fc1-9b87-ab81ec651b3a service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.190903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e38ae-256b-44a4-a315-1ef713355eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.192464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e38ae-256b-44a4-a315-1ef713355eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.192464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e38ae-256b-44a4-a315-1ef713355eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.192760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e38ae-256b-44a4-a315-1ef713355eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.193426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e38ae-256b-44a4-a315-1ef713355eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.196281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e38ae-256b-44a4-a315-1ef713355eb1 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.207423 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1140/2277] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:10.212229 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f90eb-b694-47c1-8497-a0ad8664324e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.224238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f90eb-b694-47c1-8497-a0ad8664324e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.229871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b05ce-bfdd-4623-9fb6-eac1249f239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.230815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b05ce-bfdd-4623-9fb6-eac1249f239c admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.230978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b05ce-bfdd-4623-9fb6-eac1249f239c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.231287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b05ce-bfdd-4623-9fb6-eac1249f239c admin admin] PATH_INFO: `/v3/projects/4e8f08518323453ab8315e4bc72935e3/users/1812a1ce682a4b6595cf5610d3672fb1/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.250143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b05ce-bfdd-4623-9fb6-eac1249f239c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8f08518323453ab8315e4bc72935e3, user_id=1812a1ce682a4b6595cf5610d3672fb1, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.253042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b05ce-bfdd-4623-9fb6-eac1249f239c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.284597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1138/2278] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:10 2022] PUT /identity/v3/projects/4e8f08518323453ab8315e4bc72935e3/users/1812a1ce682a4b6595cf5610d3672fb1/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:10.298065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a1d9-611a-4868-bed6-ccb318231a6b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.298349 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a1d9-611a-4868-bed6-ccb318231a6b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.298621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a1d9-611a-4868-bed6-ccb318231a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.340034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-7848a1d9-611a-4868-bed6-ccb318231a6b None None] MFA Rules not processed for user `1812a1ce682a4b6595cf5610d3672fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:10.341273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7848a1d9-611a-4868-bed6-ccb318231a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:10.368714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:10.418017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1141/2279] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:10.429769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b05ce-bfdd-4623-9fb6-eac1249f239c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.431724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-600b05ce-bfdd-4623-9fb6-eac1249f239c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:10.438811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848a1d9-611a-4868-bed6-ccb318231a6b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.440340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7848a1d9-611a-4868-bed6-ccb318231a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:10.510882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b05ce-bfdd-4623-9fb6-eac1249f239c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.514382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848a1d9-611a-4868-bed6-ccb318231a6b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.514831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc8f53-7381-4dd6-8c89-8a23397c2e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.515468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8f53-7381-4dd6-8c89-8a23397c2e19 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.515684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8f53-7381-4dd6-8c89-8a23397c2e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.515957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8f53-7381-4dd6-8c89-8a23397c2e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.519411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.520134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.520896 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.520896 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] PATH_INFO: `/v3/projects/fd1dac1f37234e35b8b479ac75d78e99` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.521931 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1dac1f37234e35b8b479ac75d78e99)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.524633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.526133 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc8f53-7381-4dd6-8c89-8a23397c2e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.527776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc8f53-7381-4dd6-8c89-8a23397c2e19 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.538307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1139/2280] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:10.592116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1dac1f37234e35b8b479ac75d78e99', 'request_id': 'req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:10.602407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1dac1f37234e35b8b479ac75d78e99', 'request_id': 'req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:10.614090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1dac1f37234e35b8b479ac75d78e99', 'request_id': 'req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:10.636666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] The token cache is being invalidate because project fd1dac1f37234e35b8b479ac75d78e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:10.637004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:10.637717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c572bb5d-ff89-4211-9bf7-0b0a7c944b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:10.642877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1142/2281] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:10 2022] DELETE /identity/v3/projects/fd1dac1f37234e35b8b479ac75d78e99 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:10.644563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279edb8-c99c-46c7-a346-5af1aee361f1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.645128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279edb8-c99c-46c7-a346-5af1aee361f1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.645128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279edb8-c99c-46c7-a346-5af1aee361f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.676503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8279edb8-c99c-46c7-a346-5af1aee361f1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:10.677643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8279edb8-c99c-46c7-a346-5af1aee361f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:10.693186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:10.796649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1140/2282] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:10.807208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76b790-6f43-4bb3-858d-66cc822f4b8a None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.807624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76b790-6f43-4bb3-858d-66cc822f4b8a None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.807975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76b790-6f43-4bb3-858d-66cc822f4b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.840277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-fa76b790-6f43-4bb3-858d-66cc822f4b8a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:10.842517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-fa76b790-6f43-4bb3-858d-66cc822f4b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:10.849659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279edb8-c99c-46c7-a346-5af1aee361f1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.851305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8279edb8-c99c-46c7-a346-5af1aee361f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:10.851888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1143/2283] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:10.856180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76b790-6f43-4bb3-858d-66cc822f4b8a None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.867918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76b790-6f43-4bb3-858d-66cc822f4b8a None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.870364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279edb8-c99c-46c7-a346-5af1aee361f1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.874027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954cf6e-40ac-4293-9c90-781a5deeb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.875033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954cf6e-40ac-4293-9c90-781a5deeb9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.875509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.875884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954cf6e-40ac-4293-9c90-781a5deeb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.876184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.876463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.876768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] PATH_INFO: `/v3/users/ef5f1e277dc24e3092083f9b40e7be4b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.877524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954cf6e-40ac-4293-9c90-781a5deeb9a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.877992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5f1e277dc24e3092083f9b40e7be4b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.879595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954cf6e-40ac-4293-9c90-781a5deeb9a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:10.880341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954cf6e-40ac-4293-9c90-781a5deeb9a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.881075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.884334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954cf6e-40ac-4293-9c90-781a5deeb9a6 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.899131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1144/2284] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:49:10.905751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954cf6e-40ac-4293-9c90-781a5deeb9a6 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.922444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954cf6e-40ac-4293-9c90-781a5deeb9a6 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:10.931842 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345ca6b-5cec-4d43-88d6-369ff473abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:10.932492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345ca6b-5cec-4d43-88d6-369ff473abac admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:10.932779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345ca6b-5cec-4d43-88d6-369ff473abac admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:10.933054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345ca6b-5cec-4d43-88d6-369ff473abac admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:10.933689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345ca6b-5cec-4d43-88d6-369ff473abac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:10.935710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345ca6b-5cec-4d43-88d6-369ff473abac admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:10.971592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1145/2285] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:10 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:10.976409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345ca6b-5cec-4d43-88d6-369ff473abac admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:10.987851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5f1e277dc24e3092083f9b40e7be4b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:10.994131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:11.001540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5f1e277dc24e3092083f9b40e7be4b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:11.011087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5f1e277dc24e3092083f9b40e7be4b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:11.030514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5f1e277dc24e3092083f9b40e7be4b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:11.031826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7773689c-4afb-4800-8d46-302a00d8d334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5f1e277dc24e3092083f9b40e7be4b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:11.040298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1141/2286] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:10 2022] DELETE /identity/v3/users/ef5f1e277dc24e3092083f9b40e7be4b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:11.044395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092bb2b-bed7-4442-9a47-e78cafc7954c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.044747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092bb2b-bed7-4442-9a47-e78cafc7954c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.045415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092bb2b-bed7-4442-9a47-e78cafc7954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.068526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7092bb2b-bed7-4442-9a47-e78cafc7954c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:11.069870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7092bb2b-bed7-4442-9a47-e78cafc7954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:11.096263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345ca6b-5cec-4d43-88d6-369ff473abac admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:11.144465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1142/2287] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:11.152218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092bb2b-bed7-4442-9a47-e78cafc7954c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:11.154617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7092bb2b-bed7-4442-9a47-e78cafc7954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:11.177947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85546f9a-2288-4458-ad32-f3bc44d9ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:11.178586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546f9a-2288-4458-ad32-f3bc44d9ba10 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.179497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546f9a-2288-4458-ad32-f3bc44d9ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.179941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546f9a-2288-4458-ad32-f3bc44d9ba10 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.180451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85546f9a-2288-4458-ad32-f3bc44d9ba10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:11.182606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85546f9a-2288-4458-ad32-f3bc44d9ba10 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:11.196286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:11.211437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1146/2288] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:10 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:11.212533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85546f9a-2288-4458-ad32-f3bc44d9ba10 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:11.214263 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-85546f9a-2288-4458-ad32-f3bc44d9ba10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:11.228101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092bb2b-bed7-4442-9a47-e78cafc7954c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:11.228298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85546f9a-2288-4458-ad32-f3bc44d9ba10 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:11.232285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c6e94-c45b-4dc4-9aae-7b2e1ae4a481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:11.232991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c6e94-c45b-4dc4-9aae-7b2e1ae4a481 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.233179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c6e94-c45b-4dc4-9aae-7b2e1ae4a481 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.233435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c6e94-c45b-4dc4-9aae-7b2e1ae4a481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.233745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e8840-cd99-42a7-bca9-629c3fc02b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:11.234444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e8840-cd99-42a7-bca9-629c3fc02b0f admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.234745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e8840-cd99-42a7-bca9-629c3fc02b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.235156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e8840-cd99-42a7-bca9-629c3fc02b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.235868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e8840-cd99-42a7-bca9-629c3fc02b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:11.239015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e8840-cd99-42a7-bca9-629c3fc02b0f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:11.245297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c6e94-c45b-4dc4-9aae-7b2e1ae4a481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:11.246794 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c6e94-c45b-4dc4-9aae-7b2e1ae4a481 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:11.249770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1147/2289] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:11.254860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e8840-cd99-42a7-bca9-629c3fc02b0f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:11.259699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1143/2290] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:11.265568 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e8840-cd99-42a7-bca9-629c3fc02b0f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:11.271174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf8d8b-9759-41c7-895e-2565675cd86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:11.271808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf8d8b-9759-41c7-895e-2565675cd86a admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.272089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf8d8b-9759-41c7-895e-2565675cd86a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.272363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf8d8b-9759-41c7-895e-2565675cd86a admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.274010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf8d8b-9759-41c7-895e-2565675cd86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:11.275694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf8d8b-9759-41c7-895e-2565675cd86a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:11.289130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1148/2291] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:11.294492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c6e94-c45b-4dc4-9aae-7b2e1ae4a481 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:11.305086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c6e94-c45b-4dc4-9aae-7b2e1ae4a481 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:11.310878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a219be6-5dc6-4807-b267-f5e23548efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:11.311580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a219be6-5dc6-4807-b267-f5e23548efc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.311874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a219be6-5dc6-4807-b267-f5e23548efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.312134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a219be6-5dc6-4807-b267-f5e23548efc2 admin admin] PATH_INFO: `/v3/projects/53abd6616db243088645bfb5850143ef/users/fd345c0cb98d4646b0e056ff7953fd5c/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.331385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a219be6-5dc6-4807-b267-f5e23548efc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53abd6616db243088645bfb5850143ef, user_id=fd345c0cb98d4646b0e056ff7953fd5c, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:11.334503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a219be6-5dc6-4807-b267-f5e23548efc2 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:11.351301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1144/2292] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:11 2022] PUT /identity/v3/projects/53abd6616db243088645bfb5850143ef/users/fd345c0cb98d4646b0e056ff7953fd5c/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:11.356393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ec12-6f7c-4f48-a44e-91d8cca26d16 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.356680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ec12-6f7c-4f48-a44e-91d8cca26d16 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.356960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ec12-6f7c-4f48-a44e-91d8cca26d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.381269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-9fe2ec12-6f7c-4f48-a44e-91d8cca26d16 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:11.383776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9fe2ec12-6f7c-4f48-a44e-91d8cca26d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:11.451364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1149/2293] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:11.460984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a219be6-5dc6-4807-b267-f5e23548efc2 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:11.462919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3a219be6-5dc6-4807-b267-f5e23548efc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:11.558613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a219be6-5dc6-4807-b267-f5e23548efc2 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:11.563917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e9b2-deea-4723-84e4-e8fccd0056ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:11.564643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e9b2-deea-4723-84e4-e8fccd0056ac service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.565024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e9b2-deea-4723-84e4-e8fccd0056ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.565381 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e9b2-deea-4723-84e4-e8fccd0056ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.577293 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e9b2-deea-4723-84e4-e8fccd0056ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:11.578990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e9b2-deea-4723-84e4-e8fccd0056ac service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:11.596175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1145/2294] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:49:11.700917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2ec12-6f7c-4f48-a44e-91d8cca26d16 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:11.702741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9fe2ec12-6f7c-4f48-a44e-91d8cca26d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:11.717412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2ec12-6f7c-4f48-a44e-91d8cca26d16 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:11.725116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:11.726450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.726958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.727248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] PATH_INFO: `/v3/projects/6898686d72fe497099a37910acb157d4` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.728448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6898686d72fe497099a37910acb157d4)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:11.730688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:11.761513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:11.795838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6898686d72fe497099a37910acb157d4', 'request_id': 'req-112d8a99-f046-42e6-a69b-62b1cb492e6d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:11.802696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6898686d72fe497099a37910acb157d4', 'request_id': 'req-112d8a99-f046-42e6-a69b-62b1cb492e6d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:11.813554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6898686d72fe497099a37910acb157d4', 'request_id': 'req-112d8a99-f046-42e6-a69b-62b1cb492e6d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:11.831390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] The token cache is being invalidate because project 6898686d72fe497099a37910acb157d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:11.842945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:11.845082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:11.853338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1150/2295] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:11 2022] DELETE /identity/v3/projects/6898686d72fe497099a37910acb157d4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:11.854301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e9b2-deea-4723-84e4-e8fccd0056ac service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:11.864745 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e9b2-deea-4723-84e4-e8fccd0056ac service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:11.975869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:11.977193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:11.977193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:11.977570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] PATH_INFO: `/v3/users/070bcf520a464e00aae66b34f12ea7f6` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:11.978911 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=070bcf520a464e00aae66b34f12ea7f6)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:11.982533 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:12.044391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070bcf520a464e00aae66b34f12ea7f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.047147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:12.059934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070bcf520a464e00aae66b34f12ea7f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.067231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:12.069598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:12.086372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070bcf520a464e00aae66b34f12ea7f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.093763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8a99-f046-42e6-a69b-62b1cb492e6d admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:12.112031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:12.113069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:12.113069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:12.113279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] PATH_INFO: `/v3/users/87912007a60f4314a7966f5898d5de71` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:12.117348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87912007a60f4314a7966f5898d5de71)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:12.123903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070bcf520a464e00aae66b34f12ea7f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.124106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:12.124922 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e24f5315-e861-4de1-ac84-30173c44a92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070bcf520a464e00aae66b34f12ea7f6'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.136530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1146/2296] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:11 2022] DELETE /identity/v3/users/070bcf520a464e00aae66b34f12ea7f6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:12.255707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87912007a60f4314a7966f5898d5de71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.257282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87912007a60f4314a7966f5898d5de71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.301533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87912007a60f4314a7966f5898d5de71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.317970 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87912007a60f4314a7966f5898d5de71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.318920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87912007a60f4314a7966f5898d5de71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:12.339939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1151/2297] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:12 2022] DELETE /identity/v3/users/87912007a60f4314a7966f5898d5de71 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:12.346370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f27a-9448-47e8-b7bc-97c45bb265b7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:12.346683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f27a-9448-47e8-b7bc-97c45bb265b7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:12.347465 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f27a-9448-47e8-b7bc-97c45bb265b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:12.374727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c8e3f27a-9448-47e8-b7bc-97c45bb265b7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:12.376667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c8e3f27a-9448-47e8-b7bc-97c45bb265b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:12.534218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1147/2298] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:12.580321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:12.582335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:12.681320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eaa46-093e-4d83-af40-976159b0468b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:12.685410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ff8cb-e66c-4c19-987c-5e7d7830bd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:12.686121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ff8cb-e66c-4c19-987c-5e7d7830bd7c service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:12.686468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ff8cb-e66c-4c19-987c-5e7d7830bd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:12.686839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ff8cb-e66c-4c19-987c-5e7d7830bd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:12.698530 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ff8cb-e66c-4c19-987c-5e7d7830bd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:12.700270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ff8cb-e66c-4c19-987c-5e7d7830bd7c service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:12.713358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1152/2299] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:13.025258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3f27a-9448-47e8-b7bc-97c45bb265b7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:13.027902 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c8e3f27a-9448-47e8-b7bc-97c45bb265b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:13.051990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3f27a-9448-47e8-b7bc-97c45bb265b7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:13.061553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:13.062195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:13.062483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:13.062750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] PATH_INFO: `/v3/projects/e632ca74977044bab0d550a1891cbeb7` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:13.064685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e632ca74977044bab0d550a1891cbeb7)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:13.072675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:13.199181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e632ca74977044bab0d550a1891cbeb7', 'request_id': 'req-48523dd7-7b80-4994-81b4-3b6869f3d6d3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.207720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e632ca74977044bab0d550a1891cbeb7', 'request_id': 'req-48523dd7-7b80-4994-81b4-3b6869f3d6d3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.220391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e632ca74977044bab0d550a1891cbeb7', 'request_id': 'req-48523dd7-7b80-4994-81b4-3b6869f3d6d3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.243071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] The token cache is being invalidate because project e632ca74977044bab0d550a1891cbeb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:13.243412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.244360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-48523dd7-7b80-4994-81b4-3b6869f3d6d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.246406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1148/2300] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:13 2022] DELETE /identity/v3/projects/e632ca74977044bab0d550a1891cbeb7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:13.252013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9113cb-9f77-4c76-9a80-c9eda2b9bc5b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:13.252657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9113cb-9f77-4c76-9a80-c9eda2b9bc5b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:13.253268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9113cb-9f77-4c76-9a80-c9eda2b9bc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:13.300532 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3b9113cb-9f77-4c76-9a80-c9eda2b9bc5b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:13.305387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3b9113cb-9f77-4c76-9a80-c9eda2b9bc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:13.351626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:13.471323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1153/2301] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:13.482666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea61c-b220-409f-9de8-780d23e23b86 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:13.483224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea61c-b220-409f-9de8-780d23e23b86 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:13.483914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea61c-b220-409f-9de8-780d23e23b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:13.540997 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9113cb-9f77-4c76-9a80-c9eda2b9bc5b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:13.543437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3b9113cb-9f77-4c76-9a80-c9eda2b9bc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:13.544664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1b2ea61c-b220-409f-9de8-780d23e23b86 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:13.548546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1b2ea61c-b220-409f-9de8-780d23e23b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:13.574086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1149/2302] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:13.577049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9113cb-9f77-4c76-9a80-c9eda2b9bc5b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:13.580530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ea61c-b220-409f-9de8-780d23e23b86 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:13.599358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:13.600314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:13.601688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:13.602128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] PATH_INFO: `/v3/users/1812a1ce682a4b6595cf5610d3672fb1` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:13.604119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1b2ea61c-b220-409f-9de8-780d23e23b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:13.604492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1812a1ce682a4b6595cf5610d3672fb1)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:13.607170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:13.638940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ea61c-b220-409f-9de8-780d23e23b86 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:13.650315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:13.653220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:13.653672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:13.654504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] PATH_INFO: `/v3/projects/3239080b68754120ab184ba96c2d7573` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:13.657918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3239080b68754120ab184ba96c2d7573)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:13.661108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:13.717425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1812a1ce682a4b6595cf5610d3672fb1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.719316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1812a1ce682a4b6595cf5610d3672fb1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.744697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1812a1ce682a4b6595cf5610d3672fb1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.758935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1812a1ce682a4b6595cf5610d3672fb1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.760860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:13.761133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1812a1ce682a4b6595cf5610d3672fb1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.778754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3239080b68754120ab184ba96c2d7573', 'request_id': 'req-235c590b-5157-4d56-86ca-bb94a9c87d06'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.794807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1154/2303] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:13 2022] DELETE /identity/v3/users/1812a1ce682a4b6595cf5610d3672fb1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:13.794807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:13.795141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3239080b68754120ab184ba96c2d7573', 'request_id': 'req-235c590b-5157-4d56-86ca-bb94a9c87d06'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.796783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:13.808890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3239080b68754120ab184ba96c2d7573', 'request_id': 'req-235c590b-5157-4d56-86ca-bb94a9c87d06'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.833079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] The token cache is being invalidate because project 3239080b68754120ab184ba96c2d7573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:13.835493 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.839200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-235c590b-5157-4d56-86ca-bb94a9c87d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:13.841496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1150/2304] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:13 2022] DELETE /identity/v3/projects/3239080b68754120ab184ba96c2d7573 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:13.844692 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1f04-02ad-4c0d-bf5f-a9b5120481ba None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:13.845072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1f04-02ad-4c0d-bf5f-a9b5120481ba None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:13.845458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1f04-02ad-4c0d-bf5f-a9b5120481ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:13.885727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-310e1f04-02ad-4c0d-bf5f-a9b5120481ba None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:13.887448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-310e1f04-02ad-4c0d-bf5f-a9b5120481ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:13.920664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8a9a4-f489-40da-8ec0-3ddaa89269be admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:13.926114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef113-2ebe-4c57-b7f9-950c5c965463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:13.926908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef113-2ebe-4c57-b7f9-950c5c965463 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:13.927279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef113-2ebe-4c57-b7f9-950c5c965463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:13.927686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef113-2ebe-4c57-b7f9-950c5c965463 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:13.929107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef113-2ebe-4c57-b7f9-950c5c965463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:13.929854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef113-2ebe-4c57-b7f9-950c5c965463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:13.931947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef113-2ebe-4c57-b7f9-950c5c965463 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:13.945378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1155/2305] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:13.946866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc9820-d516-4e72-8b88-eb09e0a4b0b8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:13.947165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc9820-d516-4e72-8b88-eb09e0a4b0b8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:13.947524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc9820-d516-4e72-8b88-eb09e0a4b0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:13.974963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-59fc9820-d516-4e72-8b88-eb09e0a4b0b8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:13.976619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-59fc9820-d516-4e72-8b88-eb09e0a4b0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:14.007810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1156/2306] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:14.015105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc9820-d516-4e72-8b88-eb09e0a4b0b8 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.015105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-59fc9820-d516-4e72-8b88-eb09e0a4b0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:14.029024 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc9820-d516-4e72-8b88-eb09e0a4b0b8 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.036696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326608d-f386-4c20-a540-62b7dd23ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.037683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326608d-f386-4c20-a540-62b7dd23ed64 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.038878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326608d-f386-4c20-a540-62b7dd23ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.039351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326608d-f386-4c20-a540-62b7dd23ed64 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.040121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326608d-f386-4c20-a540-62b7dd23ed64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.044132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326608d-f386-4c20-a540-62b7dd23ed64 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.049490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1151/2307] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:14.052326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd208e1-687c-4915-9046-38cb9ff16402 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.055601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd208e1-687c-4915-9046-38cb9ff16402 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.056237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd208e1-687c-4915-9046-38cb9ff16402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.081007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:14.099484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1157/2308] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:14 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:14.101186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326608d-f386-4c20-a540-62b7dd23ed64 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.104910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a326608d-f386-4c20-a540-62b7dd23ed64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:14.108853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9cd208e1-687c-4915-9046-38cb9ff16402 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:14.110642 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9cd208e1-687c-4915-9046-38cb9ff16402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:14.203627 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326608d-f386-4c20-a540-62b7dd23ed64 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.210040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c68c1-38a9-4986-8178-2d258bf58f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.211254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c68c1-38a9-4986-8178-2d258bf58f1e service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.213334 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c68c1-38a9-4986-8178-2d258bf58f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.213765 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c68c1-38a9-4986-8178-2d258bf58f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.231456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1152/2309] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:14.236071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd208e1-687c-4915-9046-38cb9ff16402 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.253049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd208e1-687c-4915-9046-38cb9ff16402 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.270360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e444b-7adb-4d7a-8ec5-dc4ba8a01777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.271038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e444b-7adb-4d7a-8ec5-dc4ba8a01777 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.271321 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e444b-7adb-4d7a-8ec5-dc4ba8a01777 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.271593 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e444b-7adb-4d7a-8ec5-dc4ba8a01777 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.272306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e444b-7adb-4d7a-8ec5-dc4ba8a01777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.274305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e444b-7adb-4d7a-8ec5-dc4ba8a01777 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.303779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c68c1-38a9-4986-8178-2d258bf58f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.305760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c68c1-38a9-4986-8178-2d258bf58f1e service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.321592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1158/2310] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:14.325073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c68c1-38a9-4986-8178-2d258bf58f1e service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.332345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1153/2311] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:14 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:14.336790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e444b-7adb-4d7a-8ec5-dc4ba8a01777 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.338868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c68c1-38a9-4986-8178-2d258bf58f1e service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.344232 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81225504-c492-4944-9d57-17a526e17325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.344854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81225504-c492-4944-9d57-17a526e17325 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.345131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81225504-c492-4944-9d57-17a526e17325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.345403 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81225504-c492-4944-9d57-17a526e17325 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.346053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81225504-c492-4944-9d57-17a526e17325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:14.346409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81225504-c492-4944-9d57-17a526e17325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.348731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81225504-c492-4944-9d57-17a526e17325 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.364274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e444b-7adb-4d7a-8ec5-dc4ba8a01777 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.373092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1159/2312] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:14.375203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81225504-c492-4944-9d57-17a526e17325 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.387552 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3adcc8-4e87-4cb8-bbce-dcbb188657cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.388416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3adcc8-4e87-4cb8-bbce-dcbb188657cb admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.388874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3adcc8-4e87-4cb8-bbce-dcbb188657cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.389296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3adcc8-4e87-4cb8-bbce-dcbb188657cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.389412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81225504-c492-4944-9d57-17a526e17325 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.390221 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3adcc8-4e87-4cb8-bbce-dcbb188657cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.392276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3adcc8-4e87-4cb8-bbce-dcbb188657cb admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.394745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136208b-fe2e-4a0a-ae50-dd0db6b882ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.395452 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136208b-fe2e-4a0a-ae50-dd0db6b882ee admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.395733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136208b-fe2e-4a0a-ae50-dd0db6b882ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.396058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136208b-fe2e-4a0a-ae50-dd0db6b882ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.396735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136208b-fe2e-4a0a-ae50-dd0db6b882ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.400236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136208b-fe2e-4a0a-ae50-dd0db6b882ee admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.409150 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1154/2313] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:14.415637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3adcc8-4e87-4cb8-bbce-dcbb188657cb admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.437715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3adcc8-4e87-4cb8-bbce-dcbb188657cb admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.452060 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1160/2314] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:14 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:14.454168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136208b-fe2e-4a0a-ae50-dd0db6b882ee admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.457137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25c41-1496-44c1-b6a5-02ba282a409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.458012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25c41-1496-44c1-b6a5-02ba282a409f admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.458482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25c41-1496-44c1-b6a5-02ba282a409f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.458994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25c41-1496-44c1-b6a5-02ba282a409f admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.460527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd25c41-1496-44c1-b6a5-02ba282a409f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.464614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd25c41-1496-44c1-b6a5-02ba282a409f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.491849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1155/2315] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:14.496921 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25c41-1496-44c1-b6a5-02ba282a409f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.519132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25c41-1496-44c1-b6a5-02ba282a409f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.586067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:14.636039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136208b-fe2e-4a0a-ae50-dd0db6b882ee admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.648390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be899b2-2179-4544-b637-1a6e723d1385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.650145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be899b2-2179-4544-b637-1a6e723d1385 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.650589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be899b2-2179-4544-b637-1a6e723d1385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.651885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be899b2-2179-4544-b637-1a6e723d1385 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.654029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be899b2-2179-4544-b637-1a6e723d1385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.657413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be899b2-2179-4544-b637-1a6e723d1385 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.668737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d791309-bd3f-4ef8-9d3a-daa7b24308e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.669989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d791309-bd3f-4ef8-9d3a-daa7b24308e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.669989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d791309-bd3f-4ef8-9d3a-daa7b24308e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.670256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d791309-bd3f-4ef8-9d3a-daa7b24308e8 admin admin] PATH_INFO: `/v3/projects/82ce104d2eac4b5f9f1efbaddd7646a3/users/e07defb157d94858afb30f1fed49f44e/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.692789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1161/2316] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:14 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:14.698062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be899b2-2179-4544-b637-1a6e723d1385 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.706397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:14.707324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d791309-bd3f-4ef8-9d3a-daa7b24308e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ce104d2eac4b5f9f1efbaddd7646a3, user_id=e07defb157d94858afb30f1fed49f44e, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.711222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d791309-bd3f-4ef8-9d3a-daa7b24308e8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.718915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be899b2-2179-4544-b637-1a6e723d1385 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.729178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cc130-2dea-4fd9-b441-571b25435fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.729938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cc130-2dea-4fd9-b441-571b25435fdc admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.730260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cc130-2dea-4fd9-b441-571b25435fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.730536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cc130-2dea-4fd9-b441-571b25435fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.731415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cc130-2dea-4fd9-b441-571b25435fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.733607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cc130-2dea-4fd9-b441-571b25435fdc admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.748822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1162/2317] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:14.753856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cc130-2dea-4fd9-b441-571b25435fdc admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.763755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1156/2318] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:14 2022] PUT /identity/v3/projects/82ce104d2eac4b5f9f1efbaddd7646a3/users/e07defb157d94858afb30f1fed49f44e/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:14.769881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cc130-2dea-4fd9-b441-571b25435fdc admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.775162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec76d-7bdd-4fcd-8312-8c5d4b816d2a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.775580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec76d-7bdd-4fcd-8312-8c5d4b816d2a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.776521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec76d-7bdd-4fcd-8312-8c5d4b816d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.869862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6225c5c-a4c1-44ad-a60b-cd1f6eed2721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.870498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225c5c-a4c1-44ad-a60b-cd1f6eed2721 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.870822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225c5c-a4c1-44ad-a60b-cd1f6eed2721 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.871126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225c5c-a4c1-44ad-a60b-cd1f6eed2721 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.871974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6225c5c-a4c1-44ad-a60b-cd1f6eed2721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:14.874662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6225c5c-a4c1-44ad-a60b-cd1f6eed2721 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:14.880471 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a70ec76d-7bdd-4fcd-8312-8c5d4b816d2a None None] MFA Rules not processed for user `e07defb157d94858afb30f1fed49f44e`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:14.885469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a70ec76d-7bdd-4fcd-8312-8c5d4b816d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:14.893148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1163/2319] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:14.895141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6225c5c-a4c1-44ad-a60b-cd1f6eed2721 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:14.933988 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6225c5c-a4c1-44ad-a60b-cd1f6eed2721 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:14.949778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229f4c2-ffac-4f43-acc3-dfe39e26ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:14.951130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229f4c2-ffac-4f43-acc3-dfe39e26ba3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:14.951462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229f4c2-ffac-4f43-acc3-dfe39e26ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:14.951745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229f4c2-ffac-4f43-acc3-dfe39e26ba3d admin admin] PATH_INFO: `/v3/projects/0be097335126449fbdad6700b2c48fc9/users/3758a3f053af4b9d924af0b67a04d290/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:14.995218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229f4c2-ffac-4f43-acc3-dfe39e26ba3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be097335126449fbdad6700b2c48fc9, user_id=3758a3f053af4b9d924af0b67a04d290, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:15.000845 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229f4c2-ffac-4f43-acc3-dfe39e26ba3d admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:15.040943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1164/2320] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:14 2022] PUT /identity/v3/projects/0be097335126449fbdad6700b2c48fc9/users/3758a3f053af4b9d924af0b67a04d290/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:15.056778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf19c7d-5173-4e1a-8b0a-13e3c5fafea0 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:15.057118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf19c7d-5173-4e1a-8b0a-13e3c5fafea0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:15.057329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf19c7d-5173-4e1a-8b0a-13e3c5fafea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:15.110568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1157/2321] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:15.114905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ec76d-7bdd-4fcd-8312-8c5d4b816d2a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:15.123037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ddf19c7d-5173-4e1a-8b0a-13e3c5fafea0 None None] MFA Rules not processed for user `3758a3f053af4b9d924af0b67a04d290`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:15.124285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ddf19c7d-5173-4e1a-8b0a-13e3c5fafea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:15.140971 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ec76d-7bdd-4fcd-8312-8c5d4b816d2a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:15.283684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1165/2322] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:15.295585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf19c7d-5173-4e1a-8b0a-13e3c5fafea0 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:15.297105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ddf19c7d-5173-4e1a-8b0a-13e3c5fafea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:15.320167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72527c4-955b-425e-905f-b3e7a56abaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:15.324439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72527c4-955b-425e-905f-b3e7a56abaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:15.326297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72527c4-955b-425e-905f-b3e7a56abaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:15.327795 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72527c4-955b-425e-905f-b3e7a56abaf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:15.328677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72527c4-955b-425e-905f-b3e7a56abaf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:15.331528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72527c4-955b-425e-905f-b3e7a56abaf6 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:15.378727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1158/2323] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:15 2022] POST /identity/v3/projects => generated 369 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:15.387435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72527c4-955b-425e-905f-b3e7a56abaf6 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:15.417866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf19c7d-5173-4e1a-8b0a-13e3c5fafea0 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:15.440272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:15.465645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:15.559318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee039701-9421-4dae-93fa-47da29489c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:15.559854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039701-9421-4dae-93fa-47da29489c26 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:15.560141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039701-9421-4dae-93fa-47da29489c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:15.560415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039701-9421-4dae-93fa-47da29489c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:15.585596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72527c4-955b-425e-905f-b3e7a56abaf6 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:15.603096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bc067-73ef-41cf-9b67-97e5bf5d80cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:15.605957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc067-73ef-41cf-9b67-97e5bf5d80cb admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:15.606613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc067-73ef-41cf-9b67-97e5bf5d80cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:15.607671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc067-73ef-41cf-9b67-97e5bf5d80cb admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:15.609703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bc067-73ef-41cf-9b67-97e5bf5d80cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:15.613503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bc067-73ef-41cf-9b67-97e5bf5d80cb admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:15.672887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee039701-9421-4dae-93fa-47da29489c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:15.674417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee039701-9421-4dae-93fa-47da29489c26 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:15.677260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1159/2324] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:15 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:15.682391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bc067-73ef-41cf-9b67-97e5bf5d80cb admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:15.688830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1166/2325] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:49:15.708318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bc067-73ef-41cf-9b67-97e5bf5d80cb admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:15.714927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546993e-cd06-4964-addb-5db61d22c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:15.715852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546993e-cd06-4964-addb-5db61d22c308 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:15.716412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546993e-cd06-4964-addb-5db61d22c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:15.716835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546993e-cd06-4964-addb-5db61d22c308 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:15.717636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546993e-cd06-4964-addb-5db61d22c308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:15.719477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546993e-cd06-4964-addb-5db61d22c308 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:15.737917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee039701-9421-4dae-93fa-47da29489c26 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:15.747500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1160/2326] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:15.752160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee039701-9421-4dae-93fa-47da29489c26 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:15.758926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecea43b-8eb3-48db-b502-bf347ecb8cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:15.759613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecea43b-8eb3-48db-b502-bf347ecb8cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:15.760069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecea43b-8eb3-48db-b502-bf347ecb8cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:15.760357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecea43b-8eb3-48db-b502-bf347ecb8cd1 admin admin] PATH_INFO: `/v3/projects/741ee30771b147fd8e7c06c441990cdf/users/09cae67324cd48dbb7276304a3d1aaa1/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:15.782670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecea43b-8eb3-48db-b502-bf347ecb8cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=741ee30771b147fd8e7c06c441990cdf, user_id=09cae67324cd48dbb7276304a3d1aaa1, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:15.785600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecea43b-8eb3-48db-b502-bf347ecb8cd1 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:15.810486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546993e-cd06-4964-addb-5db61d22c308 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:15.821766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1167/2327] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:15 2022] PUT /identity/v3/projects/741ee30771b147fd8e7c06c441990cdf/users/09cae67324cd48dbb7276304a3d1aaa1/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:15.822964 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546993e-cd06-4964-addb-5db61d22c308 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:15.894134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2fc32-44b5-4fca-ad52-cfa1781cad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:15.895326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2fc32-44b5-4fca-ad52-cfa1781cad18 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:15.895623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2fc32-44b5-4fca-ad52-cfa1781cad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:15.896174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2fc32-44b5-4fca-ad52-cfa1781cad18 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:15.896954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2fc32-44b5-4fca-ad52-cfa1781cad18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:15.899520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2fc32-44b5-4fca-ad52-cfa1781cad18 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:15.927606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecea43b-8eb3-48db-b502-bf347ecb8cd1 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:15.939043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1161/2328] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:15.941735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecea43b-8eb3-48db-b502-bf347ecb8cd1 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:15.943496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2fc32-44b5-4fca-ad52-cfa1781cad18 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:15.949434 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a1c2fc32-44b5-4fca-ad52-cfa1781cad18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:15.958237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04cf24-0b8b-4b37-b165-f55d7548f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:15.958960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04cf24-0b8b-4b37-b165-f55d7548f7de admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:15.964464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04cf24-0b8b-4b37-b165-f55d7548f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:15.965226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04cf24-0b8b-4b37-b165-f55d7548f7de admin admin] PATH_INFO: `/v3/projects/741ee30771b147fd8e7c06c441990cdf/users/09cae67324cd48dbb7276304a3d1aaa1/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:15.967623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04cf24-0b8b-4b37-b165-f55d7548f7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=741ee30771b147fd8e7c06c441990cdf, user_id=09cae67324cd48dbb7276304a3d1aaa1, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:15.974447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04cf24-0b8b-4b37-b165-f55d7548f7de admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:15.979102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2fc32-44b5-4fca-ad52-cfa1781cad18 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:15.993447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1168/2329] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:15 2022] PUT /identity/v3/projects/741ee30771b147fd8e7c06c441990cdf/users/09cae67324cd48dbb7276304a3d1aaa1/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:16.009923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:16.010886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:16.011804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:16.011804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] PATH_INFO: `/v3/projects/4e8f08518323453ab8315e4bc72935e3` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:16.013720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b15301-0f4a-49d7-903a-e72a268406af None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:16.016458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8f08518323453ab8315e4bc72935e3)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:16.018158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b15301-0f4a-49d7-903a-e72a268406af None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:16.019425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b15301-0f4a-49d7-903a-e72a268406af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:16.023733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:16.100016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c5b15301-0f4a-49d7-903a-e72a268406af None None] MFA Rules not processed for user `09cae67324cd48dbb7276304a3d1aaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:16.102458 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c5b15301-0f4a-49d7-903a-e72a268406af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:16.149859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8f08518323453ab8315e4bc72935e3', 'request_id': 'req-83125ba7-13dd-4d80-bb13-4754abf7da96'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:16.168658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8f08518323453ab8315e4bc72935e3', 'request_id': 'req-83125ba7-13dd-4d80-bb13-4754abf7da96'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:16.184272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8f08518323453ab8315e4bc72935e3', 'request_id': 'req-83125ba7-13dd-4d80-bb13-4754abf7da96'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:16.206386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] The token cache is being invalidate because project 4e8f08518323453ab8315e4bc72935e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:16.208504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:16.212049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:16.219276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1169/2331] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:16.219594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1162/2331] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:15 2022] DELETE /identity/v3/projects/4e8f08518323453ab8315e4bc72935e3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:16.222260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759600d-0574-497d-b504-2100f1645b17 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:16.222555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759600d-0574-497d-b504-2100f1645b17 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:16.222870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759600d-0574-497d-b504-2100f1645b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:16.262071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d759600d-0574-497d-b504-2100f1645b17 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:16.264997 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d759600d-0574-497d-b504-2100f1645b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:16.303312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:16.337310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:16.339100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:16.415515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:16.452445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1170/2332] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:16.461393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab159093-471d-4d7d-88d1-4d445658d3c9 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:16.461616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab159093-471d-4d7d-88d1-4d445658d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:16.461915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab159093-471d-4d7d-88d1-4d445658d3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:16.479143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125ba7-13dd-4d80-bb13-4754abf7da96 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:16.494267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ce4cb-09dc-4d93-b3ae-87ad41072104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:16.494941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ce4cb-09dc-4d93-b3ae-87ad41072104 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:16.495222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ce4cb-09dc-4d93-b3ae-87ad41072104 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:16.495497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ce4cb-09dc-4d93-b3ae-87ad41072104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:16.500168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ab159093-471d-4d7d-88d1-4d445658d3c9 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:16.501266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-813ce4cb-09dc-4d93-b3ae-87ad41072104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:16.501432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ab159093-471d-4d7d-88d1-4d445658d3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:16.519306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1171/2333] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:16.527012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab159093-471d-4d7d-88d1-4d445658d3c9 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:16.572546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab159093-471d-4d7d-88d1-4d445658d3c9 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:16.594185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231a5d-ce80-4900-ac01-f524f04276bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:16.595178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231a5d-ce80-4900-ac01-f524f04276bc admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:16.598680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231a5d-ce80-4900-ac01-f524f04276bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:16.600738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231a5d-ce80-4900-ac01-f524f04276bc admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:16.601917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed231a5d-ce80-4900-ac01-f524f04276bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:16.602358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed231a5d-ce80-4900-ac01-f524f04276bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:16.607690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed231a5d-ce80-4900-ac01-f524f04276bc admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:16.639362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1172/2334] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:49:16.643618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231a5d-ce80-4900-ac01-f524f04276bc admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:16.683709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231a5d-ce80-4900-ac01-f524f04276bc admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:16.706476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75840-964b-4a8d-925f-8ae7f6ccfaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:16.706759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75840-964b-4a8d-925f-8ae7f6ccfaad admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:16.707120 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75840-964b-4a8d-925f-8ae7f6ccfaad admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:16.707477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75840-964b-4a8d-925f-8ae7f6ccfaad admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:16.708065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c75840-964b-4a8d-925f-8ae7f6ccfaad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:16.714347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c75840-964b-4a8d-925f-8ae7f6ccfaad admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:16.729604 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ce4cb-09dc-4d93-b3ae-87ad41072104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:16.732247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ce4cb-09dc-4d93-b3ae-87ad41072104 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:16.761141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1163/2335] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:49:16.790747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1173/2336] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:16 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:49:16.795213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ce4cb-09dc-4d93-b3ae-87ad41072104 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:16.810669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ce4cb-09dc-4d93-b3ae-87ad41072104 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:16.935816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60d5a-c2d3-43ed-a2ed-c7f37349d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:16.936478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60d5a-c2d3-43ed-a2ed-c7f37349d793 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:16.936736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60d5a-c2d3-43ed-a2ed-c7f37349d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:16.937011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60d5a-c2d3-43ed-a2ed-c7f37349d793 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:16.937645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60d5a-c2d3-43ed-a2ed-c7f37349d793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:16.939866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60d5a-c2d3-43ed-a2ed-c7f37349d793 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:16.985317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1164/2337] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:16 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:16.989483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75840-964b-4a8d-925f-8ae7f6ccfaad admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:17.009772 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75840-964b-4a8d-925f-8ae7f6ccfaad admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:17.016886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68110a-e11c-4085-b4fa-d26658d448a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:17.027907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68110a-e11c-4085-b4fa-d26658d448a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:17.033384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68110a-e11c-4085-b4fa-d26658d448a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:17.033871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68110a-e11c-4085-b4fa-d26658d448a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:17.034722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68110a-e11c-4085-b4fa-d26658d448a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:17.036621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68110a-e11c-4085-b4fa-d26658d448a4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:17.061614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1174/2338] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:17.066418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60d5a-c2d3-43ed-a2ed-c7f37349d793 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:17.082118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60d5a-c2d3-43ed-a2ed-c7f37349d793 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:17.114285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8faed-266a-48f1-bcfc-c6d3b59cef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:17.115122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8faed-266a-48f1-bcfc-c6d3b59cef66 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:17.118081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8faed-266a-48f1-bcfc-c6d3b59cef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:17.118081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8faed-266a-48f1-bcfc-c6d3b59cef66 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:17.118081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8faed-266a-48f1-bcfc-c6d3b59cef66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:17.121037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8faed-266a-48f1-bcfc-c6d3b59cef66 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:17.165539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1165/2339] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:17.169465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68110a-e11c-4085-b4fa-d26658d448a4 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:17.191533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68110a-e11c-4085-b4fa-d26658d448a4 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:17.210389 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab61e3-15cf-4bf9-8753-f119a2c23b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:17.211197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab61e3-15cf-4bf9-8753-f119a2c23b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:17.211472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab61e3-15cf-4bf9-8753-f119a2c23b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:17.211743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab61e3-15cf-4bf9-8753-f119a2c23b4b admin admin] PATH_INFO: `/v3/projects/ade36f09e9a84bacbafccf02c8b31af4/users/ec5e6ba2ac9b47b4bb1f880d1daae4d4/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:17.252039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab61e3-15cf-4bf9-8753-f119a2c23b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade36f09e9a84bacbafccf02c8b31af4, user_id=ec5e6ba2ac9b47b4bb1f880d1daae4d4, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:17.254699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab61e3-15cf-4bf9-8753-f119a2c23b4b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:17.297130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1175/2340] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:17 2022] PUT /identity/v3/projects/ade36f09e9a84bacbafccf02c8b31af4/users/ec5e6ba2ac9b47b4bb1f880d1daae4d4/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:17.297863 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d854f-e3ec-4544-9756-d72b77c72907 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:17.298155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d854f-e3ec-4544-9756-d72b77c72907 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:17.298429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d854f-e3ec-4544-9756-d72b77c72907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:17.376067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-801d854f-e3ec-4544-9756-d72b77c72907 None None] MFA Rules not processed for user `ec5e6ba2ac9b47b4bb1f880d1daae4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:17.377865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-801d854f-e3ec-4544-9756-d72b77c72907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:17.476584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:17.539247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1166/2341] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:17.548982 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab61e3-15cf-4bf9-8753-f119a2c23b4b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:17.550787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-daab61e3-15cf-4bf9-8753-f119a2c23b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:17.689178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab61e3-15cf-4bf9-8753-f119a2c23b4b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:17.698828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc25e-aa8b-4b58-b624-343c3c87715e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d4e9baa7a6241b1807c67844c7d424c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:17.699461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc25e-aa8b-4b58-b624-343c3c87715e service glance] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:17.699742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc25e-aa8b-4b58-b624-343c3c87715e service glance] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:17.700055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc25e-aa8b-4b58-b624-343c3c87715e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:17.721503 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cc25e-aa8b-4b58-b624-343c3c87715e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:17.722978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cc25e-aa8b-4b58-b624-343c3c87715e service glance] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:17.757434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1176/2342] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:20.812941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b8223-15c4-40d5-8dfa-b901a8252f22 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:20.813388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b8223-15c4-40d5-8dfa-b901a8252f22 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:20.813546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b8223-15c4-40d5-8dfa-b901a8252f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:20.893665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-687b8223-15c4-40d5-8dfa-b901a8252f22 None None] MFA Rules not processed for user `fd345c0cb98d4646b0e056ff7953fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:20.893665 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-687b8223-15c4-40d5-8dfa-b901a8252f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:20.923932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc25e-aa8b-4b58-b624-343c3c87715e service glance] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:20.926615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-cb4cc25e-aa8b-4b58-b624-343c3c87715e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:20.989177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1167/2343] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:20.994162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:20.994721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b8223-15c4-40d5-8dfa-b901a8252f22 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:20.996955 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-687b8223-15c4-40d5-8dfa-b901a8252f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:21.025433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc25e-aa8b-4b58-b624-343c3c87715e service glance] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:21.030571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:21.031454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.032015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.032445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] PATH_INFO: `/v3/users/e07defb157d94858afb30f1fed49f44e` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.034071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07defb157d94858afb30f1fed49f44e)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:21.036218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:21.056757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b8223-15c4-40d5-8dfa-b901a8252f22 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:21.078447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b282a4-d730-4ec4-9ea8-08bc0b8e957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:21.081185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b282a4-d730-4ec4-9ea8-08bc0b8e957b admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.082119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b282a4-d730-4ec4-9ea8-08bc0b8e957b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.082359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b282a4-d730-4ec4-9ea8-08bc0b8e957b admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.084827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b282a4-d730-4ec4-9ea8-08bc0b8e957b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:21.087632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b282a4-d730-4ec4-9ea8-08bc0b8e957b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:21.110718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07defb157d94858afb30f1fed49f44e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:21.111788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07defb157d94858afb30f1fed49f44e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:21.141031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07defb157d94858afb30f1fed49f44e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:21.141806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1168/2344] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:20 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:49:21.143542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b282a4-d730-4ec4-9ea8-08bc0b8e957b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:21.158121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07defb157d94858afb30f1fed49f44e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:21.159293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e4eb7c8a-5c13-4191-b181-652c7b38e206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07defb157d94858afb30f1fed49f44e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:21.188377 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1177/2345] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:20 2022] DELETE /identity/v3/users/e07defb157d94858afb30f1fed49f44e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:21.193546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21ccc5-44d6-4370-adb4-e0f1a0cb09d8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.194354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21ccc5-44d6-4370-adb4-e0f1a0cb09d8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.194791 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21ccc5-44d6-4370-adb4-e0f1a0cb09d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.220998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-2e21ccc5-44d6-4370-adb4-e0f1a0cb09d8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:21.222531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2e21ccc5-44d6-4370-adb4-e0f1a0cb09d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:21.237167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b282a4-d730-4ec4-9ea8-08bc0b8e957b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:21.315681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:21.317280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1178/2346] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:21.326165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ac79d-aa96-4b9f-b2fa-b03241c7ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:21.327205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ac79d-aa96-4b9f-b2fa-b03241c7ab26 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.327808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ac79d-aa96-4b9f-b2fa-b03241c7ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.328037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ac79d-aa96-4b9f-b2fa-b03241c7ab26 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.340867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ac79d-aa96-4b9f-b2fa-b03241c7ab26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:21.340867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ac79d-aa96-4b9f-b2fa-b03241c7ab26 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:21.342329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21ccc5-44d6-4370-adb4-e0f1a0cb09d8 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:21.342329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2e21ccc5-44d6-4370-adb4-e0f1a0cb09d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:21.358827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1169/2347] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:21 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:21.361270 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ac79d-aa96-4b9f-b2fa-b03241c7ab26 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:21.363198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-419ac79d-aa96-4b9f-b2fa-b03241c7ab26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:21.377157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ac79d-aa96-4b9f-b2fa-b03241c7ab26 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:21.384510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ed7ca-64df-4c2c-a28d-63c237634bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:21.385440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ed7ca-64df-4c2c-a28d-63c237634bfd admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.389806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ed7ca-64df-4c2c-a28d-63c237634bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.389806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ed7ca-64df-4c2c-a28d-63c237634bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.389806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ed7ca-64df-4c2c-a28d-63c237634bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:21.389806 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ed7ca-64df-4c2c-a28d-63c237634bfd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:21.416730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1170/2348] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:21.420472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ed7ca-64df-4c2c-a28d-63c237634bfd admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:21.448682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ed7ca-64df-4c2c-a28d-63c237634bfd admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:21.458135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7064-ade2-4221-950d-34e0d0360620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:21.458839 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7064-ade2-4221-950d-34e0d0360620 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.459125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7064-ade2-4221-950d-34e0d0360620 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.459459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7064-ade2-4221-950d-34e0d0360620 admin admin] PATH_INFO: `/v3/projects/6759e21ab6ad449880ed3efdbcddf297/users/67bf2b9788f44eeaa8fc79f20e019bed/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.470899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21ccc5-44d6-4370-adb4-e0f1a0cb09d8 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:21.477981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d9be3-2abb-4e66-9798-439c7220b1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:21.479086 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9be3-2abb-4e66-9798-439c7220b1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.479470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9be3-2abb-4e66-9798-439c7220b1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.480234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9be3-2abb-4e66-9798-439c7220b1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.482662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d7064-ade2-4221-950d-34e0d0360620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6759e21ab6ad449880ed3efdbcddf297, user_id=67bf2b9788f44eeaa8fc79f20e019bed, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:21.485611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d7064-ade2-4221-950d-34e0d0360620 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:21.492605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d9be3-2abb-4e66-9798-439c7220b1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:21.494261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d9be3-2abb-4e66-9798-439c7220b1f1 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:21.500793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1171/2349] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:21 2022] PUT /identity/v3/projects/6759e21ab6ad449880ed3efdbcddf297/users/67bf2b9788f44eeaa8fc79f20e019bed/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:21.504720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7064-ade2-4221-950d-34e0d0360620 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:21.510921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1179/2350] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:49:21.589089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7064-ade2-4221-950d-34e0d0360620 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:21.598029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5445b4-30de-4703-9862-88b1179b090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:21.598974 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5445b4-30de-4703-9862-88b1179b090e admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.599245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5445b4-30de-4703-9862-88b1179b090e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.599589 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5445b4-30de-4703-9862-88b1179b090e admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.600635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5445b4-30de-4703-9862-88b1179b090e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:21.602855 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5445b4-30de-4703-9862-88b1179b090e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:21.619810 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1172/2351] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:21.624245 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d9be3-2abb-4e66-9798-439c7220b1f1 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:21.629688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:21.637995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d9be3-2abb-4e66-9798-439c7220b1f1 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:21.644653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914880a-b034-4254-81fa-02c3743cdf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:21.646151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914880a-b034-4254-81fa-02c3743cdf9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.646672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914880a-b034-4254-81fa-02c3743cdf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.647310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914880a-b034-4254-81fa-02c3743cdf9d admin admin] PATH_INFO: `/v3/projects/6759e21ab6ad449880ed3efdbcddf297/users/67bf2b9788f44eeaa8fc79f20e019bed/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.653066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914880a-b034-4254-81fa-02c3743cdf9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6759e21ab6ad449880ed3efdbcddf297, user_id=67bf2b9788f44eeaa8fc79f20e019bed, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:21.656482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914880a-b034-4254-81fa-02c3743cdf9d admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:21.672407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1180/2352] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:21 2022] PUT /identity/v3/projects/6759e21ab6ad449880ed3efdbcddf297/users/67bf2b9788f44eeaa8fc79f20e019bed/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:21.825960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e0b0c-a7b5-4cca-8b91-bc0bae39b506 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:21.826539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e0b0c-a7b5-4cca-8b91-bc0bae39b506 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:21.826809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e0b0c-a7b5-4cca-8b91-bc0bae39b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:21.878027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f57e0b0c-a7b5-4cca-8b91-bc0bae39b506 None None] MFA Rules not processed for user `352a102f604048138df5a31bab4f8cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:21.880212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f57e0b0c-a7b5-4cca-8b91-bc0bae39b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:22.006031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1173/2353] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:22.320704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914880a-b034-4254-81fa-02c3743cdf9d admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:22.322630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9914880a-b034-4254-81fa-02c3743cdf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:22.419168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914880a-b034-4254-81fa-02c3743cdf9d admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:22.427021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:22.427686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:22.428867 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:22.429386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] PATH_INFO: `/v3/projects/82ce104d2eac4b5f9f1efbaddd7646a3` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:22.430757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ce104d2eac4b5f9f1efbaddd7646a3)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:22.433024 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:22.533231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ce104d2eac4b5f9f1efbaddd7646a3', 'request_id': 'req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.544109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ce104d2eac4b5f9f1efbaddd7646a3', 'request_id': 'req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.559741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ce104d2eac4b5f9f1efbaddd7646a3', 'request_id': 'req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.578420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] The token cache is being invalidate because project 82ce104d2eac4b5f9f1efbaddd7646a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:22.578760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.579725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.581506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1181/2354] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:22 2022] DELETE /identity/v3/projects/82ce104d2eac4b5f9f1efbaddd7646a3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:22.586140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e0b0c-a7b5-4cca-8b91-bc0bae39b506 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:22.621834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e0b0c-a7b5-4cca-8b91-bc0bae39b506 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:22.757122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:22.774379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:22.775413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:22.775891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:22.776328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] PATH_INFO: `/v3/users/09cae67324cd48dbb7276304a3d1aaa1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:22.778184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09cae67324cd48dbb7276304a3d1aaa1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:22.781139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:22.901393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09cae67324cd48dbb7276304a3d1aaa1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.916875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09cae67324cd48dbb7276304a3d1aaa1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.929400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09cae67324cd48dbb7276304a3d1aaa1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.945368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09cae67324cd48dbb7276304a3d1aaa1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.946431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fb5e058-bc9a-48ef-bd32-88f1a035c301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09cae67324cd48dbb7276304a3d1aaa1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:22.953602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1174/2355] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:22 2022] DELETE /identity/v3/users/09cae67324cd48dbb7276304a3d1aaa1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:23.492641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:23.494206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:23.516282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9fa24-c9eb-44cc-a0b0-536151d7c408 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:23.588248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:23.589018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:23.589362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:23.589857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] PATH_INFO: `/v3/projects/741ee30771b147fd8e7c06c441990cdf` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:23.591269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=741ee30771b147fd8e7c06c441990cdf)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:23.593774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:23.627655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:23.660889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741ee30771b147fd8e7c06c441990cdf', 'request_id': 'req-7b02dff3-30f5-4e8d-ab02-5644ef7df842'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:23.673072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741ee30771b147fd8e7c06c441990cdf', 'request_id': 'req-7b02dff3-30f5-4e8d-ab02-5644ef7df842'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:23.686977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741ee30771b147fd8e7c06c441990cdf', 'request_id': 'req-7b02dff3-30f5-4e8d-ab02-5644ef7df842'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:23.710441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] The token cache is being invalidate because project 741ee30771b147fd8e7c06c441990cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:23.710715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:23.713104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7b02dff3-30f5-4e8d-ab02-5644ef7df842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:23.715780 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1182/2356] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:23 2022] DELETE /identity/v3/projects/741ee30771b147fd8e7c06c441990cdf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:23.720560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947bf2-4916-44d7-bcb1-991a6c237bd7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:23.721200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947bf2-4916-44d7-bcb1-991a6c237bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:23.721787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947bf2-4916-44d7-bcb1-991a6c237bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:23.745029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-88947bf2-4916-44d7-bcb1-991a6c237bd7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:23.746690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-88947bf2-4916-44d7-bcb1-991a6c237bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:23.854232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1175/2357] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:23.864051 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec329-d1f3-4302-a547-945a9ed6a826 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:23.864335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec329-d1f3-4302-a547-945a9ed6a826 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:23.864613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec329-d1f3-4302-a547-945a9ed6a826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:23.902222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-eecec329-d1f3-4302-a547-945a9ed6a826 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:23.904133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-eecec329-d1f3-4302-a547-945a9ed6a826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:23.931116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1183/2358] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:23.931918 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88947bf2-4916-44d7-bcb1-991a6c237bd7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:23.957161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88947bf2-4916-44d7-bcb1-991a6c237bd7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:23.967293 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b6fc6-fbdc-4fb0-a280-e64e39d81b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:23.967919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6fc6-fbdc-4fb0-a280-e64e39d81b2a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:23.968202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6fc6-fbdc-4fb0-a280-e64e39d81b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:23.968497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6fc6-fbdc-4fb0-a280-e64e39d81b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:23.969141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b6fc6-fbdc-4fb0-a280-e64e39d81b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:23.969444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b6fc6-fbdc-4fb0-a280-e64e39d81b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:23.971866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b6fc6-fbdc-4fb0-a280-e64e39d81b2a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:24.013279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1176/2359] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:24.018413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecec329-d1f3-4302-a547-945a9ed6a826 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:24.039082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecec329-d1f3-4302-a547-945a9ed6a826 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:24.053886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b740a-1813-4358-b5a7-50e631b9df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:24.054519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b740a-1813-4358-b5a7-50e631b9df5c admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:24.054907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b740a-1813-4358-b5a7-50e631b9df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:24.055136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b740a-1813-4358-b5a7-50e631b9df5c admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:24.055810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b740a-1813-4358-b5a7-50e631b9df5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:24.058005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b740a-1813-4358-b5a7-50e631b9df5c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:24.125662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1184/2360] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:24 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:49:24.130110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b6fc6-fbdc-4fb0-a280-e64e39d81b2a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:24.159117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b6fc6-fbdc-4fb0-a280-e64e39d81b2a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:24.361868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2d81-3f4d-49e4-aad7-980e870652ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:24.362506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2d81-3f4d-49e4-aad7-980e870652ef admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:24.362938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2d81-3f4d-49e4-aad7-980e870652ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:24.363526 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2d81-3f4d-49e4-aad7-980e870652ef admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:24.364245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2d81-3f4d-49e4-aad7-980e870652ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:24.366297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2d81-3f4d-49e4-aad7-980e870652ef admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:24.389226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:24.421671 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b740a-1813-4358-b5a7-50e631b9df5c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:24.425126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1177/2361] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:24 2022] POST /identity/v3/users => generated 304 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:24.443285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b740a-1813-4358-b5a7-50e631b9df5c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:24.455900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f79ad-cba7-4f95-88ec-85d1618118ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:24.457080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f79ad-cba7-4f95-88ec-85d1618118ed admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:24.457457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f79ad-cba7-4f95-88ec-85d1618118ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:24.457825 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f79ad-cba7-4f95-88ec-85d1618118ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:24.458574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f79ad-cba7-4f95-88ec-85d1618118ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:24.462100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f79ad-cba7-4f95-88ec-85d1618118ed admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:24.481864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1185/2362] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:24.485935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2d81-3f4d-49e4-aad7-980e870652ef admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:24.518197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2d81-3f4d-49e4-aad7-980e870652ef admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:24.537309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7eef0-2fde-481d-9ac4-f849bb69500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:24.538609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7eef0-2fde-481d-9ac4-f849bb69500a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:24.539161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7eef0-2fde-481d-9ac4-f849bb69500a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:24.539586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7eef0-2fde-481d-9ac4-f849bb69500a admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:24.540236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7eef0-2fde-481d-9ac4-f849bb69500a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:24.541877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7eef0-2fde-481d-9ac4-f849bb69500a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:24.556876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1178/2363] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:24.562225 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f79ad-cba7-4f95-88ec-85d1618118ed admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:24.594578 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f79ad-cba7-4f95-88ec-85d1618118ed admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:24.614038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7954-0261-46e2-99a3-011e6c4b8a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:24.614901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7954-0261-46e2-99a3-011e6c4b8a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:24.615289 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7954-0261-46e2-99a3-011e6c4b8a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:24.615696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7954-0261-46e2-99a3-011e6c4b8a6a admin admin] PATH_INFO: `/v3/projects/9edff9d8819040c2a247ecadedbc4d9d/users/5f1f9cfa9b9345b99f891390c511b44a/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:24.644466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e7954-0261-46e2-99a3-011e6c4b8a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edff9d8819040c2a247ecadedbc4d9d, user_id=5f1f9cfa9b9345b99f891390c511b44a, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:24.649291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e7954-0261-46e2-99a3-011e6c4b8a6a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:24.694271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec180646-1b41-448d-9f25-c6502da695a3 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:24.694655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec180646-1b41-448d-9f25-c6502da695a3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:24.695261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec180646-1b41-448d-9f25-c6502da695a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:24.698166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1186/2364] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:24 2022] PUT /identity/v3/projects/9edff9d8819040c2a247ecadedbc4d9d/users/5f1f9cfa9b9345b99f891390c511b44a/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:24.779318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ec180646-1b41-448d-9f25-c6502da695a3 None None] MFA Rules not processed for user `5f1f9cfa9b9345b99f891390c511b44a`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:24.781295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ec180646-1b41-448d-9f25-c6502da695a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:24.901865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1179/2365] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:24.907224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7954-0261-46e2-99a3-011e6c4b8a6a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:25.004564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7954-0261-46e2-99a3-011e6c4b8a6a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:25.016869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4565552-573b-4c3a-a5d3-59b1c5407da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:25.019062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4565552-573b-4c3a-a5d3-59b1c5407da3 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:25.019446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4565552-573b-4c3a-a5d3-59b1c5407da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:25.021519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4565552-573b-4c3a-a5d3-59b1c5407da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:25.022929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4565552-573b-4c3a-a5d3-59b1c5407da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:25.027422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4565552-573b-4c3a-a5d3-59b1c5407da3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:25.103353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1187/2366] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:24 2022] POST /identity/v3/projects => generated 407 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:25.106929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec180646-1b41-448d-9f25-c6502da695a3 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:25.134079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec180646-1b41-448d-9f25-c6502da695a3 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:25.279408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d2bee-96c4-4870-a9ee-98718a3ff078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:25.280186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d2bee-96c4-4870-a9ee-98718a3ff078 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:25.280477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d2bee-96c4-4870-a9ee-98718a3ff078 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:25.280752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d2bee-96c4-4870-a9ee-98718a3ff078 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:25.281396 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d2bee-96c4-4870-a9ee-98718a3ff078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:25.283527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d2bee-96c4-4870-a9ee-98718a3ff078 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:25.319681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1180/2367] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:25 2022] POST /identity/v3/users => generated 310 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:25.327705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4565552-573b-4c3a-a5d3-59b1c5407da3 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:25.367957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4565552-573b-4c3a-a5d3-59b1c5407da3 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:25.383499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968db01-3e53-4371-85a0-38c9dfec4840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:25.385610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968db01-3e53-4371-85a0-38c9dfec4840 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:25.385998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968db01-3e53-4371-85a0-38c9dfec4840 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:25.388318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968db01-3e53-4371-85a0-38c9dfec4840 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:25.388318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968db01-3e53-4371-85a0-38c9dfec4840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:25.392190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968db01-3e53-4371-85a0-38c9dfec4840 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:25.424631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1188/2368] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:25.429237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d2bee-96c4-4870-a9ee-98718a3ff078 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:25.441360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d2bee-96c4-4870-a9ee-98718a3ff078 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:25.449729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731c114-63a4-4421-8fb2-bc68754676d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:25.452204 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731c114-63a4-4421-8fb2-bc68754676d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:25.452542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731c114-63a4-4421-8fb2-bc68754676d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:25.452822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731c114-63a4-4421-8fb2-bc68754676d4 admin admin] PATH_INFO: `/v3/projects/7fce137b549640d2ba03c5441025f157/users/7ade64541ae5499ba031e89f28a05d0e/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:25.476630 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731c114-63a4-4421-8fb2-bc68754676d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fce137b549640d2ba03c5441025f157, user_id=7ade64541ae5499ba031e89f28a05d0e, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:25.479392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731c114-63a4-4421-8fb2-bc68754676d4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:25.502130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968db01-3e53-4371-85a0-38c9dfec4840 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:25.504352 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1181/2369] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:25 2022] PUT /identity/v3/projects/7fce137b549640d2ba03c5441025f157/users/7ade64541ae5499ba031e89f28a05d0e/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:25.517071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968db01-3e53-4371-85a0-38c9dfec4840 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:25.554073 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:25.667734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacc565-16f7-4d6e-8ca2-f843ccf8d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:25.669664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacc565-16f7-4d6e-8ca2-f843ccf8d430 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:25.670178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacc565-16f7-4d6e-8ca2-f843ccf8d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:25.670611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacc565-16f7-4d6e-8ca2-f843ccf8d430 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:25.671542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacc565-16f7-4d6e-8ca2-f843ccf8d430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:25.674959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacc565-16f7-4d6e-8ca2-f843ccf8d430 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:25.694337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1189/2370] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:49:25.699586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731c114-63a4-4421-8fb2-bc68754676d4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:25.718549 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731c114-63a4-4421-8fb2-bc68754676d4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:25.729267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f9c0-bc7f-4d64-bdcc-1351f4e3a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:25.730051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f9c0-bc7f-4d64-bdcc-1351f4e3a2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:25.730401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f9c0-bc7f-4d64-bdcc-1351f4e3a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:25.730743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f9c0-bc7f-4d64-bdcc-1351f4e3a2ae admin admin] PATH_INFO: `/v3/projects/7fce137b549640d2ba03c5441025f157/users/7ade64541ae5499ba031e89f28a05d0e/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:25.739332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217f9c0-bc7f-4d64-bdcc-1351f4e3a2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fce137b549640d2ba03c5441025f157, user_id=7ade64541ae5499ba031e89f28a05d0e, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:25.746113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217f9c0-bc7f-4d64-bdcc-1351f4e3a2ae admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:25.792660 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56250-5401-425c-bef8-82fbd2b9c065 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:25.792909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1182/2371] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:25 2022] PUT /identity/v3/projects/7fce137b549640d2ba03c5441025f157/users/7ade64541ae5499ba031e89f28a05d0e/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:25.793113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56250-5401-425c-bef8-82fbd2b9c065 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:25.793485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56250-5401-425c-bef8-82fbd2b9c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:25.844492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-23b56250-5401-425c-bef8-82fbd2b9c065 None None] MFA Rules not processed for user `7ade64541ae5499ba031e89f28a05d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:25.846158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-23b56250-5401-425c-bef8-82fbd2b9c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:26.002642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1190/2372] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:26.020768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f9c0-bc7f-4d64-bdcc-1351f4e3a2ae admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:26.024050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8217f9c0-bc7f-4d64-bdcc-1351f4e3a2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:26.066140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:26.163734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f9c0-bc7f-4d64-bdcc-1351f4e3a2ae admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:26.182367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f05fc4-f2d7-4eb1-acf2-abc7fe0ea1fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:26.183531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f05fc4-f2d7-4eb1-acf2-abc7fe0ea1fa service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:26.184566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f05fc4-f2d7-4eb1-acf2-abc7fe0ea1fa service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:26.185632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f05fc4-f2d7-4eb1-acf2-abc7fe0ea1fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:26.212899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f05fc4-f2d7-4eb1-acf2-abc7fe0ea1fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:26.214699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f05fc4-f2d7-4eb1-acf2-abc7fe0ea1fa service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:26.239686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1183/2373] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:26 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:26.474447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b56250-5401-425c-bef8-82fbd2b9c065 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:26.489089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b56250-5401-425c-bef8-82fbd2b9c065 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:26.499726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff11998-f7ee-4431-9ada-189594b36629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:26.500727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff11998-f7ee-4431-9ada-189594b36629 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:26.516763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff11998-f7ee-4431-9ada-189594b36629 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:26.517915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff11998-f7ee-4431-9ada-189594b36629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:26.683372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff11998-f7ee-4431-9ada-189594b36629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:26.685233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff11998-f7ee-4431-9ada-189594b36629 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:26.708020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1191/2374] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:26 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:29.015173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5a9e-8e94-4d82-8f7c-873cc4c3b2a3 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:29.015727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5a9e-8e94-4d82-8f7c-873cc4c3b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:29.015727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5a9e-8e94-4d82-8f7c-873cc4c3b2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:29.060326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-33ad5a9e-8e94-4d82-8f7c-873cc4c3b2a3 None None] MFA Rules not processed for user `67bf2b9788f44eeaa8fc79f20e019bed`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:29.061582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-33ad5a9e-8e94-4d82-8f7c-873cc4c3b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:29.140174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1184/2375] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:29.156177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff11998-f7ee-4431-9ada-189594b36629 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:29.158093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0ff11998-f7ee-4431-9ada-189594b36629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:29.212018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:29.245460 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff11998-f7ee-4431-9ada-189594b36629 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:29.251058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b1c39-4fa0-4fd4-860e-4432b5fa4c39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:29.251731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b1c39-4fa0-4fd4-860e-4432b5fa4c39 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:29.251964 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b1c39-4fa0-4fd4-860e-4432b5fa4c39 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:29.252234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b1c39-4fa0-4fd4-860e-4432b5fa4c39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:29.254085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-680b1c39-4fa0-4fd4-860e-4432b5fa4c39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:29.342649 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b1c39-4fa0-4fd4-860e-4432b5fa4c39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:29.344312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b1c39-4fa0-4fd4-860e-4432b5fa4c39 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:29.356763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1192/2376] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:30.451814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5a9e-8e94-4d82-8f7c-873cc4c3b2a3 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:30.453431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-33ad5a9e-8e94-4d82-8f7c-873cc4c3b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:30.563999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5a9e-8e94-4d82-8f7c-873cc4c3b2a3 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:30.569892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:30.571044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:30.571904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:30.572386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] PATH_INFO: `/v3/users/3758a3f053af4b9d924af0b67a04d290` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:30.575186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3758a3f053af4b9d924af0b67a04d290)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:30.577737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:30.649370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3758a3f053af4b9d924af0b67a04d290'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.652257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:30.659701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3758a3f053af4b9d924af0b67a04d290'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.670300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3758a3f053af4b9d924af0b67a04d290'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.692366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3758a3f053af4b9d924af0b67a04d290'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.693289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a34eff3f-6256-4a26-9f78-9725376d882b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3758a3f053af4b9d924af0b67a04d290'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.706052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1185/2377] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:30 2022] DELETE /identity/v3/users/3758a3f053af4b9d924af0b67a04d290 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:30.708512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360f0fa-1729-4994-b4f6-d0ce58259608 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:30.709658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360f0fa-1729-4994-b4f6-d0ce58259608 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:30.709866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360f0fa-1729-4994-b4f6-d0ce58259608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:30.734669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd919c0a-114e-45f7-8fa3-a3870371bfbf None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:30.734985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd919c0a-114e-45f7-8fa3-a3870371bfbf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:30.735256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd919c0a-114e-45f7-8fa3-a3870371bfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:30.749176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-4360f0fa-1729-4994-b4f6-d0ce58259608 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:30.751821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4360f0fa-1729-4994-b4f6-d0ce58259608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:30.766318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-bd919c0a-114e-45f7-8fa3-a3870371bfbf None None] MFA Rules not processed for user `fd345c0cb98d4646b0e056ff7953fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:30.768439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bd919c0a-114e-45f7-8fa3-a3870371bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:30.864548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1193/2378] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:30.875031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1186/2379] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:30.880071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360f0fa-1729-4994-b4f6-d0ce58259608 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:30.881678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4360f0fa-1729-4994-b4f6-d0ce58259608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:30.972872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360f0fa-1729-4994-b4f6-d0ce58259608 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:30.979009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd682e-ebf9-49ce-b2b0-48b6b8ef89a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:30.979862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd682e-ebf9-49ce-b2b0-48b6b8ef89a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:30.980234 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd682e-ebf9-49ce-b2b0-48b6b8ef89a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:30.980714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd682e-ebf9-49ce-b2b0-48b6b8ef89a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:30.993343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd682e-ebf9-49ce-b2b0-48b6b8ef89a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:30.995101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd682e-ebf9-49ce-b2b0-48b6b8ef89a4 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:31.008754 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1194/2380] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:31.438459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd919c0a-114e-45f7-8fa3-a3870371bfbf None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:31.441024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bd919c0a-114e-45f7-8fa3-a3870371bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:31.460206 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd919c0a-114e-45f7-8fa3-a3870371bfbf None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:31.466676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:31.467594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:31.468170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:31.468444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] PATH_INFO: `/v3/projects/0be097335126449fbdad6700b2c48fc9` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:31.469664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be097335126449fbdad6700b2c48fc9)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:31.471917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:31.530234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be097335126449fbdad6700b2c48fc9', 'request_id': 'req-61cf6525-d1a9-4566-9c8a-dd80fa867692'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:31.536571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be097335126449fbdad6700b2c48fc9', 'request_id': 'req-61cf6525-d1a9-4566-9c8a-dd80fa867692'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:31.545673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be097335126449fbdad6700b2c48fc9', 'request_id': 'req-61cf6525-d1a9-4566-9c8a-dd80fa867692'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:31.564748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] The token cache is being invalidate because project 0be097335126449fbdad6700b2c48fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:31.565071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:31.565770 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-61cf6525-d1a9-4566-9c8a-dd80fa867692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:31.567323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1187/2381] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:31 2022] DELETE /identity/v3/projects/0be097335126449fbdad6700b2c48fc9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:32.659224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd682e-ebf9-49ce-b2b0-48b6b8ef89a4 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:32.660797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f5bd682e-ebf9-49ce-b2b0-48b6b8ef89a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:32.681034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd682e-ebf9-49ce-b2b0-48b6b8ef89a4 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:32.700163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:32.789040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:32.790014 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:32.791108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:32.791553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] PATH_INFO: `/v3/users/5f1f9cfa9b9345b99f891390c511b44a` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:32.793005 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1f9cfa9b9345b99f891390c511b44a)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:32.795380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:32.884974 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1f9cfa9b9345b99f891390c511b44a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:32.886125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1f9cfa9b9345b99f891390c511b44a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:32.901516 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1f9cfa9b9345b99f891390c511b44a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:32.911496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1f9cfa9b9345b99f891390c511b44a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:32.912991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1f9cfa9b9345b99f891390c511b44a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:32.937218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1195/2382] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:32 2022] DELETE /identity/v3/users/5f1f9cfa9b9345b99f891390c511b44a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:32.939163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af20eb-8a90-4956-9065-d25433a63f07 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:32.940040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af20eb-8a90-4956-9065-d25433a63f07 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:32.940325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af20eb-8a90-4956-9065-d25433a63f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:32.961199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c9af20eb-8a90-4956-9065-d25433a63f07 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:32.962551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c9af20eb-8a90-4956-9065-d25433a63f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:33.031872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:33.053393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1188/2383] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:33.063776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:33.065250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:33.149558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd575b1-fda8-4a65-9e4d-7573db62cd25 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:33.157167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea827ffe-7546-4e1c-a040-ef53765c459e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:33.159955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea827ffe-7546-4e1c-a040-ef53765c459e service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:33.160828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea827ffe-7546-4e1c-a040-ef53765c459e service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:33.161590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea827ffe-7546-4e1c-a040-ef53765c459e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:33.185793 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea827ffe-7546-4e1c-a040-ef53765c459e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:33.189356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea827ffe-7546-4e1c-a040-ef53765c459e service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:33.202830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1196/2384] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:33.513785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af20eb-8a90-4956-9065-d25433a63f07 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:33.515263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c9af20eb-8a90-4956-9065-d25433a63f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:33.528341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af20eb-8a90-4956-9065-d25433a63f07 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:33.533915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:33.534563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:33.534871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:33.535144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] PATH_INFO: `/v3/projects/9edff9d8819040c2a247ecadedbc4d9d` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:33.536485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edff9d8819040c2a247ecadedbc4d9d)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:33.538718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:33.605432 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edff9d8819040c2a247ecadedbc4d9d', 'request_id': 'req-7cc12aee-c900-476c-8505-f18d8a166e07'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.611624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edff9d8819040c2a247ecadedbc4d9d', 'request_id': 'req-7cc12aee-c900-476c-8505-f18d8a166e07'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.620017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edff9d8819040c2a247ecadedbc4d9d', 'request_id': 'req-7cc12aee-c900-476c-8505-f18d8a166e07'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.632581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] The token cache is being invalidate because project 9edff9d8819040c2a247ecadedbc4d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:33.632868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.633788 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.635615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1189/2385] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:33 2022] DELETE /identity/v3/projects/9edff9d8819040c2a247ecadedbc4d9d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:33.639622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea827ffe-7546-4e1c-a040-ef53765c459e service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:33.649549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea827ffe-7546-4e1c-a040-ef53765c459e service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:33.691869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:33.710521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:33.711190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:33.711465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:33.711739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] PATH_INFO: `/v3/users/7ade64541ae5499ba031e89f28a05d0e` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:33.712851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ade64541ae5499ba031e89f28a05d0e)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:33.714743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:33.768125 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ade64541ae5499ba031e89f28a05d0e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.768772 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ade64541ae5499ba031e89f28a05d0e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.781037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ade64541ae5499ba031e89f28a05d0e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.792417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ade64541ae5499ba031e89f28a05d0e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.793187 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-37925618-0c6d-4b1a-bf62-0276a1ffd402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ade64541ae5499ba031e89f28a05d0e'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:33.813500 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1197/2386] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:33 2022] DELETE /identity/v3/users/7ade64541ae5499ba031e89f28a05d0e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:34.123079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:34.124741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:34.141377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc12aee-c900-476c-8505-f18d8a166e07 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:34.221938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:34.222485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.222780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.223067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] PATH_INFO: `/v3/projects/7fce137b549640d2ba03c5441025f157` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.224179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fce137b549640d2ba03c5441025f157)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:34.226258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:34.286743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fce137b549640d2ba03c5441025f157', 'request_id': 'req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:34.293401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fce137b549640d2ba03c5441025f157', 'request_id': 'req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:34.306097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fce137b549640d2ba03c5441025f157', 'request_id': 'req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:34.317772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] The token cache is being invalidate because project 7fce137b549640d2ba03c5441025f157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:34.318068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:34.319683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b71d41e6-18b4-4c1c-a228-5c5c86d483b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:34.324473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1190/2387] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:34 2022] DELETE /identity/v3/projects/7fce137b549640d2ba03c5441025f157 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:34.329374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9522e-2626-4ade-a364-1eff42999581 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.329689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9522e-2626-4ade-a364-1eff42999581 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.329943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9522e-2626-4ade-a364-1eff42999581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.351907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-88a9522e-2626-4ade-a364-1eff42999581 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:34.352518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-88a9522e-2626-4ade-a364-1eff42999581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:34.423768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1198/2388] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:34.432701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f573-ab34-4533-9fdb-b6a81cd80618 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.433273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f573-ab34-4533-9fdb-b6a81cd80618 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.433557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f573-ab34-4533-9fdb-b6a81cd80618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.454857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7994f573-ab34-4533-9fdb-b6a81cd80618 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:34.456076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7994f573-ab34-4533-9fdb-b6a81cd80618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:34.464938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1191/2389] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:34.469281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9522e-2626-4ade-a364-1eff42999581 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:34.479646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9522e-2626-4ade-a364-1eff42999581 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:34.484432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b67945-a791-4724-83d0-0c5270a5b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:34.485041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b67945-a791-4724-83d0-0c5270a5b388 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.485323 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b67945-a791-4724-83d0-0c5270a5b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.485598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b67945-a791-4724-83d0-0c5270a5b388 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.486305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b67945-a791-4724-83d0-0c5270a5b388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:34.486600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b67945-a791-4724-83d0-0c5270a5b388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:34.488555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b67945-a791-4724-83d0-0c5270a5b388 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:34.502351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1199/2390] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:49:34.507529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994f573-ab34-4533-9fdb-b6a81cd80618 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:34.513326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:34.522450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994f573-ab34-4533-9fdb-b6a81cd80618 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:34.534408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd46fb-9a02-4717-bd3b-99a9b1073475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:34.535634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd46fb-9a02-4717-bd3b-99a9b1073475 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.538562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd46fb-9a02-4717-bd3b-99a9b1073475 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.539012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd46fb-9a02-4717-bd3b-99a9b1073475 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.540254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd46fb-9a02-4717-bd3b-99a9b1073475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:34.543425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd46fb-9a02-4717-bd3b-99a9b1073475 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:34.590599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1192/2391] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:34 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:49:34.596425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b67945-a791-4724-83d0-0c5270a5b388 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:34.611629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b67945-a791-4724-83d0-0c5270a5b388 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:34.677013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:34.693074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1e2fc-4a47-47c0-857a-23206c266bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:34.694588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1e2fc-4a47-47c0-857a-23206c266bcf admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.694940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1e2fc-4a47-47c0-857a-23206c266bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.695222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1e2fc-4a47-47c0-857a-23206c266bcf admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.695866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1e2fc-4a47-47c0-857a-23206c266bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:34.697818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1e2fc-4a47-47c0-857a-23206c266bcf admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:34.725321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1200/2392] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:34 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:34.729273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd46fb-9a02-4717-bd3b-99a9b1073475 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:34.753949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd46fb-9a02-4717-bd3b-99a9b1073475 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:34.776128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cbabe-9929-43e1-8082-b4ca1e0f3eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:34.776771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cbabe-9929-43e1-8082-b4ca1e0f3eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.777053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cbabe-9929-43e1-8082-b4ca1e0f3eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.777326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cbabe-9929-43e1-8082-b4ca1e0f3eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.777989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cbabe-9929-43e1-8082-b4ca1e0f3eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:34.779883 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cbabe-9929-43e1-8082-b4ca1e0f3eb1 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:34.791684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1193/2393] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:34.795694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1e2fc-4a47-47c0-857a-23206c266bcf admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:34.807217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1e2fc-4a47-47c0-857a-23206c266bcf admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:34.812078 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500001f-9455-4bc4-bfa5-9d37b5268f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:34.812693 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500001f-9455-4bc4-bfa5-9d37b5268f14 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.812972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500001f-9455-4bc4-bfa5-9d37b5268f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.813266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500001f-9455-4bc4-bfa5-9d37b5268f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.813935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500001f-9455-4bc4-bfa5-9d37b5268f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:34.815677 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500001f-9455-4bc4-bfa5-9d37b5268f14 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:34.827910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1201/2394] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:34.832161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cbabe-9929-43e1-8082-b4ca1e0f3eb1 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:34.842952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cbabe-9929-43e1-8082-b4ca1e0f3eb1 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:34.847536 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02990-8c44-4e96-8386-1a5334e21fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:34.848194 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02990-8c44-4e96-8386-1a5334e21fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.848475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02990-8c44-4e96-8386-1a5334e21fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.848750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02990-8c44-4e96-8386-1a5334e21fa8 admin admin] PATH_INFO: `/v3/projects/33ffd2f78ff742d6a8e98d20d2b1eadb/users/96bc6668468640d98c6620d777b2b3a1/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.866375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d02990-8c44-4e96-8386-1a5334e21fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ffd2f78ff742d6a8e98d20d2b1eadb, user_id=96bc6668468640d98c6620d777b2b3a1, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:34.869105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d02990-8c44-4e96-8386-1a5334e21fa8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:34.891919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1194/2395] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:34 2022] PUT /identity/v3/projects/33ffd2f78ff742d6a8e98d20d2b1eadb/users/96bc6668468640d98c6620d777b2b3a1/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:34.909537 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eacb6-e1e7-4a8f-9723-41b842c1afde None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:34.909847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eacb6-e1e7-4a8f-9723-41b842c1afde None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:34.910124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eacb6-e1e7-4a8f-9723-41b842c1afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:34.942366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-577eacb6-e1e7-4a8f-9723-41b842c1afde None None] MFA Rules not processed for user `96bc6668468640d98c6620d777b2b3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:34.944286 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-577eacb6-e1e7-4a8f-9723-41b842c1afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:35.011538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1202/2396] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:35.016045 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02990-8c44-4e96-8386-1a5334e21fa8 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:35.102648 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02990-8c44-4e96-8386-1a5334e21fa8 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:35.116919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fbb7c-6225-4502-82a0-3ebb0409176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:35.117687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fbb7c-6225-4502-82a0-3ebb0409176b admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:35.118126 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fbb7c-6225-4502-82a0-3ebb0409176b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:35.119002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fbb7c-6225-4502-82a0-3ebb0409176b admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:35.119378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fbb7c-6225-4502-82a0-3ebb0409176b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:35.121397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fbb7c-6225-4502-82a0-3ebb0409176b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:35.168482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1195/2397] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:35 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:35.172727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eacb6-e1e7-4a8f-9723-41b842c1afde None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:35.186249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eacb6-e1e7-4a8f-9723-41b842c1afde None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:35.280479 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23696-abc5-4362-8953-93bc0cabd575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:35.281025 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23696-abc5-4362-8953-93bc0cabd575 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:35.281308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23696-abc5-4362-8953-93bc0cabd575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:35.281636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23696-abc5-4362-8953-93bc0cabd575 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:35.282216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec23696-abc5-4362-8953-93bc0cabd575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:35.284767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec23696-abc5-4362-8953-93bc0cabd575 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:35.315548 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1203/2398] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:35 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:35.319572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fbb7c-6225-4502-82a0-3ebb0409176b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:35.332246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fbb7c-6225-4502-82a0-3ebb0409176b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:35.338117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cdf61-83ed-48fa-8ee7-67c04c7251f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:35.338760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cdf61-83ed-48fa-8ee7-67c04c7251f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:35.339268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cdf61-83ed-48fa-8ee7-67c04c7251f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:35.339395 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cdf61-83ed-48fa-8ee7-67c04c7251f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:35.342427 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cdf61-83ed-48fa-8ee7-67c04c7251f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:35.346385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cdf61-83ed-48fa-8ee7-67c04c7251f9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:35.362337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1196/2399] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:35.363823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23696-abc5-4362-8953-93bc0cabd575 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:35.376638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23696-abc5-4362-8953-93bc0cabd575 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:35.382661 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120f321-9194-4327-a68f-7ff6229a22ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:35.384036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120f321-9194-4327-a68f-7ff6229a22ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:35.384319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120f321-9194-4327-a68f-7ff6229a22ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:35.384740 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120f321-9194-4327-a68f-7ff6229a22ca admin admin] PATH_INFO: `/v3/projects/87e6000dca6b4874bbdafeff876bd861/users/b9c4b896c33e4bd699071acf0c98ceae/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:35.403620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120f321-9194-4327-a68f-7ff6229a22ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e6000dca6b4874bbdafeff876bd861, user_id=b9c4b896c33e4bd699071acf0c98ceae, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:35.406650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120f321-9194-4327-a68f-7ff6229a22ca admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:35.420802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1204/2400] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:35 2022] PUT /identity/v3/projects/87e6000dca6b4874bbdafeff876bd861/users/b9c4b896c33e4bd699071acf0c98ceae/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:35.426483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cdf61-83ed-48fa-8ee7-67c04c7251f9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:35.440745 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cdf61-83ed-48fa-8ee7-67c04c7251f9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:35.525936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99700-41e5-42d3-b27b-a264a8c6bbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:35.526428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99700-41e5-42d3-b27b-a264a8c6bbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:35.526708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99700-41e5-42d3-b27b-a264a8c6bbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:35.527258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99700-41e5-42d3-b27b-a264a8c6bbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:35.527963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb99700-41e5-42d3-b27b-a264a8c6bbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:35.530089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb99700-41e5-42d3-b27b-a264a8c6bbc8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:35.541994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1197/2401] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:35.546424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120f321-9194-4327-a68f-7ff6229a22ca admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:35.560755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120f321-9194-4327-a68f-7ff6229a22ca admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:35.567422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe417b-f20d-4dff-9332-b995ef93dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:35.568137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe417b-f20d-4dff-9332-b995ef93dbea admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:35.568775 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe417b-f20d-4dff-9332-b995ef93dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:35.569111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe417b-f20d-4dff-9332-b995ef93dbea admin admin] PATH_INFO: `/v3/projects/87e6000dca6b4874bbdafeff876bd861/users/b9c4b896c33e4bd699071acf0c98ceae/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:35.571930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe417b-f20d-4dff-9332-b995ef93dbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e6000dca6b4874bbdafeff876bd861, user_id=b9c4b896c33e4bd699071acf0c98ceae, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:35.574435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe417b-f20d-4dff-9332-b995ef93dbea admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:35.600574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1205/2402] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:35 2022] PUT /identity/v3/projects/87e6000dca6b4874bbdafeff876bd861/users/b9c4b896c33e4bd699071acf0c98ceae/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:35.603232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f306b15-21ff-4174-a9cb-ec5baf887b08 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:35.603523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f306b15-21ff-4174-a9cb-ec5baf887b08 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:35.603801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f306b15-21ff-4174-a9cb-ec5baf887b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:35.640764 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6f306b15-21ff-4174-a9cb-ec5baf887b08 None None] MFA Rules not processed for user `b9c4b896c33e4bd699071acf0c98ceae`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:35.642205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6f306b15-21ff-4174-a9cb-ec5baf887b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:35.647750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:35.752407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1198/2403] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:35.769450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe417b-f20d-4dff-9332-b995ef93dbea admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:35.769450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2afe417b-f20d-4dff-9332-b995ef93dbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:35.796924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:35.858421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe417b-f20d-4dff-9332-b995ef93dbea admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:35.863214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73944c-8803-472c-b49a-e34d912fca90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:35.863938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73944c-8803-472c-b49a-e34d912fca90 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:35.864329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73944c-8803-472c-b49a-e34d912fca90 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:35.864706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73944c-8803-472c-b49a-e34d912fca90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:35.970995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73944c-8803-472c-b49a-e34d912fca90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:35.973386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73944c-8803-472c-b49a-e34d912fca90 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:35.988343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1206/2404] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:38.622757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f306b15-21ff-4174-a9cb-ec5baf887b08 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:38.713747 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f306b15-21ff-4174-a9cb-ec5baf887b08 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:38.718659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:38.719543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:38.719831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:38.720165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] PATH_INFO: `/v3/users/96bc6668468640d98c6620d777b2b3a1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:38.721617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bc6668468640d98c6620d777b2b3a1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:38.724314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:38.795606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bc6668468640d98c6620d777b2b3a1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:38.810752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bc6668468640d98c6620d777b2b3a1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:38.827500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bc6668468640d98c6620d777b2b3a1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:38.860979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bc6668468640d98c6620d777b2b3a1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:38.861973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bc6668468640d98c6620d777b2b3a1'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:38.875617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1199/2405] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:38 2022] DELETE /identity/v3/users/96bc6668468640d98c6620d777b2b3a1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:38.878454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87af4-4501-4ea0-8d25-b2c807fb45bd None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:38.879506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87af4-4501-4ea0-8d25-b2c807fb45bd None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:38.879901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87af4-4501-4ea0-8d25-b2c807fb45bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:38.926477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a8b87af4-4501-4ea0-8d25-b2c807fb45bd None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:38.928554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a8b87af4-4501-4ea0-8d25-b2c807fb45bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:39.016715 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1207/2406] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:39.028761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:39.030196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:39.064742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:39.112787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847db4-3d46-4fdc-b072-757b8208fe74 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:39.117282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbb2f7-5407-4f95-b30c-ef54951741a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:39.117898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbb2f7-5407-4f95-b30c-ef54951741a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:39.118173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbb2f7-5407-4f95-b30c-ef54951741a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:39.118440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbb2f7-5407-4f95-b30c-ef54951741a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:39.131517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbb2f7-5407-4f95-b30c-ef54951741a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:39.133583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbb2f7-5407-4f95-b30c-ef54951741a7 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:39.157698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1200/2407] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:39.646448 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87af4-4501-4ea0-8d25-b2c807fb45bd None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:39.649277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a8b87af4-4501-4ea0-8d25-b2c807fb45bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:39.682016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87af4-4501-4ea0-8d25-b2c807fb45bd None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:39.697871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:39.698539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:39.698850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:39.699179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] PATH_INFO: `/v3/projects/33ffd2f78ff742d6a8e98d20d2b1eadb` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:39.700335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ffd2f78ff742d6a8e98d20d2b1eadb)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:39.702560 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:39.780543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ffd2f78ff742d6a8e98d20d2b1eadb', 'request_id': 'req-6784cbe2-7253-459f-93f0-e8701a53a70b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:39.804565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ffd2f78ff742d6a8e98d20d2b1eadb', 'request_id': 'req-6784cbe2-7253-459f-93f0-e8701a53a70b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:39.808315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:39.817930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ffd2f78ff742d6a8e98d20d2b1eadb', 'request_id': 'req-6784cbe2-7253-459f-93f0-e8701a53a70b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:39.852483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] The token cache is being invalidate because project 33ffd2f78ff742d6a8e98d20d2b1eadb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:39.852779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:39.853570 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:39.863189 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1208/2408] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:39 2022] DELETE /identity/v3/projects/33ffd2f78ff742d6a8e98d20d2b1eadb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:39.868998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbb2f7-5407-4f95-b30c-ef54951741a7 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:39.889038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbb2f7-5407-4f95-b30c-ef54951741a7 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:40.018489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:40.019390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:40.019757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:40.020779 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] PATH_INFO: `/v3/users/b9c4b896c33e4bd699071acf0c98ceae` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:40.021805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c4b896c33e4bd699071acf0c98ceae)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:40.024001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:40.126024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c4b896c33e4bd699071acf0c98ceae'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:40.134838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c4b896c33e4bd699071acf0c98ceae'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:40.145304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c4b896c33e4bd699071acf0c98ceae'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:40.162738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c4b896c33e4bd699071acf0c98ceae'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:40.163966 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-3ad2aca7-0d11-4b3d-8dc5-21ae08086ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c4b896c33e4bd699071acf0c98ceae'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:40.171349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1201/2409] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:39 2022] DELETE /identity/v3/users/b9c4b896c33e4bd699071acf0c98ceae => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:40.866203 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:40.874093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:40.889907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784cbe2-7253-459f-93f0-e8701a53a70b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:40.981074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:40.982854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:40.983317 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:40.983756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] PATH_INFO: `/v3/projects/87e6000dca6b4874bbdafeff876bd861` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:40.985790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e6000dca6b4874bbdafeff876bd861)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:40.987954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:41.080370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e6000dca6b4874bbdafeff876bd861', 'request_id': 'req-6b1c63b2-37e6-455b-9100-0370e4868fab'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:41.086969 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e6000dca6b4874bbdafeff876bd861', 'request_id': 'req-6b1c63b2-37e6-455b-9100-0370e4868fab'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:41.097067 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e6000dca6b4874bbdafeff876bd861', 'request_id': 'req-6b1c63b2-37e6-455b-9100-0370e4868fab'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:41.110281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] The token cache is being invalidate because project 87e6000dca6b4874bbdafeff876bd861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:41.110855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:41.111556 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6b1c63b2-37e6-455b-9100-0370e4868fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:41.113947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1209/2410] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:40 2022] DELETE /identity/v3/projects/87e6000dca6b4874bbdafeff876bd861 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:41.118620 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264a57-f389-43f3-b832-c76a2a02cea0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.119199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264a57-f389-43f3-b832-c76a2a02cea0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.119378 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264a57-f389-43f3-b832-c76a2a02cea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:41.149037 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f8264a57-f389-43f3-b832-c76a2a02cea0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:41.150399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f8264a57-f389-43f3-b832-c76a2a02cea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:41.205623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:41.231826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1202/2411] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:41.239690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73063227-9890-4445-bcc0-7804b94d1574 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.240043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73063227-9890-4445-bcc0-7804b94d1574 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.240333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73063227-9890-4445-bcc0-7804b94d1574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:41.263512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-73063227-9890-4445-bcc0-7804b94d1574 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:41.264555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-73063227-9890-4445-bcc0-7804b94d1574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:41.275257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1210/2412] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:41.280353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264a57-f389-43f3-b832-c76a2a02cea0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:41.291885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264a57-f389-43f3-b832-c76a2a02cea0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:41.297372 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c2bc6-9f1a-419d-bf90-08e6e5cfef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:41.297803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c2bc6-9f1a-419d-bf90-08e6e5cfef2d admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.298081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c2bc6-9f1a-419d-bf90-08e6e5cfef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.298360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c2bc6-9f1a-419d-bf90-08e6e5cfef2d admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:41.299121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c2bc6-9f1a-419d-bf90-08e6e5cfef2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:41.299439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c2bc6-9f1a-419d-bf90-08e6e5cfef2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:41.301140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c2bc6-9f1a-419d-bf90-08e6e5cfef2d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:41.322114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73063227-9890-4445-bcc0-7804b94d1574 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:41.326730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1203/2413] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:41.337835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73063227-9890-4445-bcc0-7804b94d1574 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:41.346991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeec0e2-bbad-490b-943f-4bba4f9f8655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:41.346991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec0e2-bbad-490b-943f-4bba4f9f8655 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.346991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec0e2-bbad-490b-943f-4bba4f9f8655 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.346991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec0e2-bbad-490b-943f-4bba4f9f8655 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:41.347348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeec0e2-bbad-490b-943f-4bba4f9f8655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:41.349256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeec0e2-bbad-490b-943f-4bba4f9f8655 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:41.422201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1211/2414] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:41 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:49:41.438464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c2bc6-9f1a-419d-bf90-08e6e5cfef2d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:41.453245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c2bc6-9f1a-419d-bf90-08e6e5cfef2d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:41.565828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da54c5-5e16-4bdb-9309-345f5b8f0d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:41.566478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da54c5-5e16-4bdb-9309-345f5b8f0d1e admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.566745 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da54c5-5e16-4bdb-9309-345f5b8f0d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.567064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da54c5-5e16-4bdb-9309-345f5b8f0d1e admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:41.567709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da54c5-5e16-4bdb-9309-345f5b8f0d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:41.570588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da54c5-5e16-4bdb-9309-345f5b8f0d1e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:41.600701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1204/2415] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:41 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:41.604664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeec0e2-bbad-490b-943f-4bba4f9f8655 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:41.619502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeec0e2-bbad-490b-943f-4bba4f9f8655 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:41.624581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab64f0f-d9b8-4d8a-bb87-9e3844722a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:41.625218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab64f0f-d9b8-4d8a-bb87-9e3844722a8c admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.625495 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab64f0f-d9b8-4d8a-bb87-9e3844722a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.625772 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab64f0f-d9b8-4d8a-bb87-9e3844722a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:41.626467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab64f0f-d9b8-4d8a-bb87-9e3844722a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:41.628072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab64f0f-d9b8-4d8a-bb87-9e3844722a8c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:41.641178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1212/2416] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:41.645413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da54c5-5e16-4bdb-9309-345f5b8f0d1e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:41.656632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da54c5-5e16-4bdb-9309-345f5b8f0d1e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:41.661644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ad4c1-cc0a-49be-aa0c-c3fc457aeed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:41.662375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ad4c1-cc0a-49be-aa0c-c3fc457aeed2 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.663497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ad4c1-cc0a-49be-aa0c-c3fc457aeed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.663497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ad4c1-cc0a-49be-aa0c-c3fc457aeed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:41.663702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ad4c1-cc0a-49be-aa0c-c3fc457aeed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:41.665228 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ad4c1-cc0a-49be-aa0c-c3fc457aeed2 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:41.675540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1205/2417] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:41.680332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab64f0f-d9b8-4d8a-bb87-9e3844722a8c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:41.690253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab64f0f-d9b8-4d8a-bb87-9e3844722a8c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:41.695774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1d9b-18e8-4073-bc75-41eaec965b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:41.696438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1d9b-18e8-4073-bc75-41eaec965b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.696784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1d9b-18e8-4073-bc75-41eaec965b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.697063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1d9b-18e8-4073-bc75-41eaec965b90 admin admin] PATH_INFO: `/v3/projects/8c57f13cfd474d81af57e91ec3ccb0d2/users/244fcebee5bf41fcb9c30e1b4019bd97/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:41.712164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f1d9b-18e8-4073-bc75-41eaec965b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c57f13cfd474d81af57e91ec3ccb0d2, user_id=244fcebee5bf41fcb9c30e1b4019bd97, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:41.714927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f1d9b-18e8-4073-bc75-41eaec965b90 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:41.727846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1213/2418] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:41 2022] PUT /identity/v3/projects/8c57f13cfd474d81af57e91ec3ccb0d2/users/244fcebee5bf41fcb9c30e1b4019bd97/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:41.800678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5a7b-3a3f-45e1-86e1-ba6dc6179521 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.800959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5a7b-3a3f-45e1-86e1-ba6dc6179521 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.801236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5a7b-3a3f-45e1-86e1-ba6dc6179521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:41.835303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-347c5a7b-3a3f-45e1-86e1-ba6dc6179521 None None] MFA Rules not processed for user `244fcebee5bf41fcb9c30e1b4019bd97`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:41.836870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-347c5a7b-3a3f-45e1-86e1-ba6dc6179521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:41.913349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1206/2419] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:41.924110 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1d9b-18e8-4073-bc75-41eaec965b90 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:41.925947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-184f1d9b-18e8-4073-bc75-41eaec965b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:41.941171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:41.987589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1d9b-18e8-4073-bc75-41eaec965b90 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:41.992189 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60b0a2-562d-4873-8e66-442dde971fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:41.992876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60b0a2-562d-4873-8e66-442dde971fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:41.993097 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60b0a2-562d-4873-8e66-442dde971fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:41.993370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60b0a2-562d-4873-8e66-442dde971fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:42.002796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60b0a2-562d-4873-8e66-442dde971fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:42.004237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60b0a2-562d-4873-8e66-442dde971fb7 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:42.014619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1214/2420] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:43.403934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b036-1b6a-49b8-8ae0-18f43f36d5fd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:43.404439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b036-1b6a-49b8-8ae0-18f43f36d5fd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:43.404535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b036-1b6a-49b8-8ae0-18f43f36d5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:43.548369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ac27b036-1b6a-49b8-8ae0-18f43f36d5fd None None] MFA Rules not processed for user `244fcebee5bf41fcb9c30e1b4019bd97`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:43.549584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ac27b036-1b6a-49b8-8ae0-18f43f36d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:43.557067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1207/2421] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:47.571027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fb2f6-c198-4033-a039-9bcffe943097 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:47.576072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fb2f6-c198-4033-a039-9bcffe943097 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:47.576072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fb2f6-c198-4033-a039-9bcffe943097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:47.607567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b70fb2f6-c198-4033-a039-9bcffe943097 None None] MFA Rules not processed for user `5d210b7348594c3da477a1b6b77dfb34`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:47.609089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b70fb2f6-c198-4033-a039-9bcffe943097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:47.629208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28b65-a0a1-4075-9e51-0b9e680a5e07 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:47.630380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28b65-a0a1-4075-9e51-0b9e680a5e07 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:47.630891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28b65-a0a1-4075-9e51-0b9e680a5e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:47.671338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-22c28b65-a0a1-4075-9e51-0b9e680a5e07 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:47.672641 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-22c28b65-a0a1-4075-9e51-0b9e680a5e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:47.707961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1215/2422] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:47.734869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:47.791415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1208/2423] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:48.008494 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fb2f6-c198-4033-a039-9bcffe943097 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:48.010021 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b70fb2f6-c198-4033-a039-9bcffe943097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:48.116270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fb2f6-c198-4033-a039-9bcffe943097 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:48.123958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b82f4d-6572-4843-9b78-55849a03898d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:48.125051 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b82f4d-6572-4843-9b78-55849a03898d service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:48.125051 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b82f4d-6572-4843-9b78-55849a03898d service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:48.125550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b82f4d-6572-4843-9b78-55849a03898d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:48.137639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b82f4d-6572-4843-9b78-55849a03898d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:48.139378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b82f4d-6572-4843-9b78-55849a03898d service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:48.151703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1216/2424] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:49:48.630379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c28b65-a0a1-4075-9e51-0b9e680a5e07 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:48.633423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-22c28b65-a0a1-4075-9e51-0b9e680a5e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:48.647556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c28b65-a0a1-4075-9e51-0b9e680a5e07 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:48.653246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:48.653812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:48.654152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:48.654444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] PATH_INFO: `/v3/users/ec5e6ba2ac9b47b4bb1f880d1daae4d4` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:48.655993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec5e6ba2ac9b47b4bb1f880d1daae4d4)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:48.658004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:48.720335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5e6ba2ac9b47b4bb1f880d1daae4d4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:48.731901 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5e6ba2ac9b47b4bb1f880d1daae4d4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:48.740371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5e6ba2ac9b47b4bb1f880d1daae4d4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:48.754351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5e6ba2ac9b47b4bb1f880d1daae4d4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:48.755125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5e6ba2ac9b47b4bb1f880d1daae4d4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:48.762581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1209/2425] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:48 2022] DELETE /identity/v3/users/ec5e6ba2ac9b47b4bb1f880d1daae4d4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:48.767219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901898-30bf-4e37-9476-4a264c1ed477 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:48.767708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901898-30bf-4e37-9476-4a264c1ed477 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:48.767803 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901898-30bf-4e37-9476-4a264c1ed477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:48.787979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b6901898-30bf-4e37-9476-4a264c1ed477 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:48.789293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b6901898-30bf-4e37-9476-4a264c1ed477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:48.860429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:48.885860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1217/2426] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:48.895782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:48.897749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:48.976281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3065b4-5570-4e8f-aa89-cbf702c7fb00 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:48.980781 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a28866-eaf5-4c2c-8f76-445125b8c291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:48.981584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a28866-eaf5-4c2c-8f76-445125b8c291 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:48.981913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a28866-eaf5-4c2c-8f76-445125b8c291 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:48.982304 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a28866-eaf5-4c2c-8f76-445125b8c291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:48.993484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a28866-eaf5-4c2c-8f76-445125b8c291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:48.995027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a28866-eaf5-4c2c-8f76-445125b8c291 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:49.020111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1210/2427] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:49.418490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6901898-30bf-4e37-9476-4a264c1ed477 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:49.420325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b6901898-30bf-4e37-9476-4a264c1ed477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:49.435316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6901898-30bf-4e37-9476-4a264c1ed477 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:49.440158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:49.441102 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:49.441734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:49.442328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] PATH_INFO: `/v3/projects/ade36f09e9a84bacbafccf02c8b31af4` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:49.444747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade36f09e9a84bacbafccf02c8b31af4)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:49.446928 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:49.511341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade36f09e9a84bacbafccf02c8b31af4', 'request_id': 'req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:49.523910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade36f09e9a84bacbafccf02c8b31af4', 'request_id': 'req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:49.535174 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade36f09e9a84bacbafccf02c8b31af4', 'request_id': 'req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:49.570716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] The token cache is being invalidate because project ade36f09e9a84bacbafccf02c8b31af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:49.571124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:49.571898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6fa97146-ed20-4fb7-8d2f-2c8f469ebf57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:49.573496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1218/2428] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:49 2022] DELETE /identity/v3/projects/ade36f09e9a84bacbafccf02c8b31af4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:49.578290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a7f1-a05b-4619-a99e-c7ce9f9006f0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:49.578578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a7f1-a05b-4619-a99e-c7ce9f9006f0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:49.578892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a7f1-a05b-4619-a99e-c7ce9f9006f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:49.599726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a231a7f1-a05b-4619-a99e-c7ce9f9006f0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:49.600983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a231a7f1-a05b-4619-a99e-c7ce9f9006f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:49.648364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:49.675262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1211/2429] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:49.680278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478b628-307e-4aa9-bfce-23f2bc3782e7 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:49.680561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478b628-307e-4aa9-bfce-23f2bc3782e7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:49.680834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478b628-307e-4aa9-bfce-23f2bc3782e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:49.702172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e478b628-307e-4aa9-bfce-23f2bc3782e7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:49.703429 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e478b628-307e-4aa9-bfce-23f2bc3782e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:49.713977 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1219/2430] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:49.718460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a7f1-a05b-4619-a99e-c7ce9f9006f0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:49.732528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a7f1-a05b-4619-a99e-c7ce9f9006f0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:49.738090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b865fd-a9f3-461a-8e9a-c4d765d10b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:49.738739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b865fd-a9f3-461a-8e9a-c4d765d10b8c admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:49.739036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b865fd-a9f3-461a-8e9a-c4d765d10b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:49.739303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b865fd-a9f3-461a-8e9a-c4d765d10b8c admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:49.740572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b865fd-a9f3-461a-8e9a-c4d765d10b8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:49.740875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b865fd-a9f3-461a-8e9a-c4d765d10b8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:49.742504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b865fd-a9f3-461a-8e9a-c4d765d10b8c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:49.756736 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1212/2431] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:49.761574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478b628-307e-4aa9-bfce-23f2bc3782e7 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:49.771586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478b628-307e-4aa9-bfce-23f2bc3782e7 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:49.776487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9485dd1-0e4c-4c73-ba52-84c8b0feeab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:49.777092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9485dd1-0e4c-4c73-ba52-84c8b0feeab0 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:49.777400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9485dd1-0e4c-4c73-ba52-84c8b0feeab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:49.777669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9485dd1-0e4c-4c73-ba52-84c8b0feeab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:49.778302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9485dd1-0e4c-4c73-ba52-84c8b0feeab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:49.780265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9485dd1-0e4c-4c73-ba52-84c8b0feeab0 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:49.809266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1220/2432] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:49 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:49:49.813573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b865fd-a9f3-461a-8e9a-c4d765d10b8c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:49.825088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b865fd-a9f3-461a-8e9a-c4d765d10b8c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:49.893816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df89e5-6b6e-4f5b-91fa-18fff13ebcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:49.894945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df89e5-6b6e-4f5b-91fa-18fff13ebcd9 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:49.895333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df89e5-6b6e-4f5b-91fa-18fff13ebcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:49.895725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df89e5-6b6e-4f5b-91fa-18fff13ebcd9 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:49.896487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df89e5-6b6e-4f5b-91fa-18fff13ebcd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:49.898578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df89e5-6b6e-4f5b-91fa-18fff13ebcd9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:49.921807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1213/2433] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:49 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:49.926889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9485dd1-0e4c-4c73-ba52-84c8b0feeab0 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:49.938107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9485dd1-0e4c-4c73-ba52-84c8b0feeab0 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:49.943185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded464-fc18-439f-9c5a-ee020e305e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:49.943885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded464-fc18-439f-9c5a-ee020e305e16 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:49.944160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded464-fc18-439f-9c5a-ee020e305e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:49.944430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded464-fc18-439f-9c5a-ee020e305e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:49.947270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ded464-fc18-439f-9c5a-ee020e305e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:49.948903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ded464-fc18-439f-9c5a-ee020e305e16 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:49.960929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1221/2434] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:49.965048 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df89e5-6b6e-4f5b-91fa-18fff13ebcd9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:49.976625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df89e5-6b6e-4f5b-91fa-18fff13ebcd9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:49.982945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679903b-4bd6-4a70-b27b-9fe648f5f0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:49.983556 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679903b-4bd6-4a70-b27b-9fe648f5f0dc admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:49.983835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679903b-4bd6-4a70-b27b-9fe648f5f0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:49.984105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679903b-4bd6-4a70-b27b-9fe648f5f0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:49.984852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679903b-4bd6-4a70-b27b-9fe648f5f0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:49.986519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679903b-4bd6-4a70-b27b-9fe648f5f0dc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:49.997685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1214/2435] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:50.002038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded464-fc18-439f-9c5a-ee020e305e16 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:50.014031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded464-fc18-439f-9c5a-ee020e305e16 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:50.018798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34f2ae-7313-4fc6-9645-ae573264236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:50.019488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34f2ae-7313-4fc6-9645-ae573264236c admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:50.019769 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34f2ae-7313-4fc6-9645-ae573264236c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:50.020039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34f2ae-7313-4fc6-9645-ae573264236c admin admin] PATH_INFO: `/v3/projects/899a23499b9c450fa77b8d635d071123/users/aadb173fef1347adaaf9b7b6b034a36d/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:50.037463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34f2ae-7313-4fc6-9645-ae573264236c admin admin] RBAC: Authorizing `identity:create_grant(project_id=899a23499b9c450fa77b8d635d071123, user_id=aadb173fef1347adaaf9b7b6b034a36d, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:50.040027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34f2ae-7313-4fc6-9645-ae573264236c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:50.056157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1222/2436] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:50 2022] PUT /identity/v3/projects/899a23499b9c450fa77b8d635d071123/users/aadb173fef1347adaaf9b7b6b034a36d/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:50.067245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c88cf-061c-4c21-9667-9af92e76458d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:50.067529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c88cf-061c-4c21-9667-9af92e76458d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:50.068364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c88cf-061c-4c21-9667-9af92e76458d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:50.106737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fd6c88cf-061c-4c21-9667-9af92e76458d None None] MFA Rules not processed for user `aadb173fef1347adaaf9b7b6b034a36d`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:50.108121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fd6c88cf-061c-4c21-9667-9af92e76458d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:50.242234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1215/2437] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:50.255483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34f2ae-7313-4fc6-9645-ae573264236c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:50.257417 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5d34f2ae-7313-4fc6-9645-ae573264236c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:50.372400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34f2ae-7313-4fc6-9645-ae573264236c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:50.377304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1121af9-8b9d-4659-a49c-21c8a4e5d29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:50.377926 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1121af9-8b9d-4659-a49c-21c8a4e5d29a service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:50.378218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1121af9-8b9d-4659-a49c-21c8a4e5d29a service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:50.378489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1121af9-8b9d-4659-a49c-21c8a4e5d29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:50.391320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1121af9-8b9d-4659-a49c-21c8a4e5d29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:50.393976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1121af9-8b9d-4659-a49c-21c8a4e5d29a service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:50.407691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1223/2438] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:50.440976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c88cf-061c-4c21-9667-9af92e76458d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:50.527752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:50.549335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c88cf-061c-4c21-9667-9af92e76458d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:50.554580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:50.555268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:50.555623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:50.556086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] PATH_INFO: `/v3/users/aadb173fef1347adaaf9b7b6b034a36d` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:50.558290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadb173fef1347adaaf9b7b6b034a36d)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:50.561935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:50.616877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadb173fef1347adaaf9b7b6b034a36d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:50.623941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadb173fef1347adaaf9b7b6b034a36d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:50.632682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadb173fef1347adaaf9b7b6b034a36d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:50.645166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadb173fef1347adaaf9b7b6b034a36d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:50.647184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadb173fef1347adaaf9b7b6b034a36d'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:50.653301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1216/2439] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:50 2022] DELETE /identity/v3/users/aadb173fef1347adaaf9b7b6b034a36d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:49:50.658162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492157-d1a4-4c80-a959-eb2dd76c47cb None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:50.658456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492157-d1a4-4c80-a959-eb2dd76c47cb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:50.658942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492157-d1a4-4c80-a959-eb2dd76c47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:50.684672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-42492157-d1a4-4c80-a959-eb2dd76c47cb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:50.685819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-42492157-d1a4-4c80-a959-eb2dd76c47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:50.689889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:50.754004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1224/2440] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:50.764477 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:50.765983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:50.824867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d602bdc-b622-45d3-b82f-3e2e2c39186a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:50.829223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818b1bf-468e-4ab6-a661-7de286426604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:50.829981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818b1bf-468e-4ab6-a661-7de286426604 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:50.830350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818b1bf-468e-4ab6-a661-7de286426604 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:50.830618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818b1bf-468e-4ab6-a661-7de286426604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:50.849910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818b1bf-468e-4ab6-a661-7de286426604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:50.852094 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818b1bf-468e-4ab6-a661-7de286426604 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:50.862889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1217/2441] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:51.157473 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42492157-d1a4-4c80-a959-eb2dd76c47cb None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:51.159415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-42492157-d1a4-4c80-a959-eb2dd76c47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:51.179335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42492157-d1a4-4c80-a959-eb2dd76c47cb None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:51.186653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:51.187776 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.188094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.188390 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] PATH_INFO: `/v3/projects/899a23499b9c450fa77b8d635d071123` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.189619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899a23499b9c450fa77b8d635d071123)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:51.191864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:51.245787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899a23499b9c450fa77b8d635d071123', 'request_id': 'req-c81f32ee-ea84-46f2-9306-8d897fb3d189'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:51.251524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899a23499b9c450fa77b8d635d071123', 'request_id': 'req-c81f32ee-ea84-46f2-9306-8d897fb3d189'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:51.261846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899a23499b9c450fa77b8d635d071123', 'request_id': 'req-c81f32ee-ea84-46f2-9306-8d897fb3d189'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:51.274949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] The token cache is being invalidate because project 899a23499b9c450fa77b8d635d071123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:51.275239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:51.275894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c81f32ee-ea84-46f2-9306-8d897fb3d189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:51.277395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1225/2442] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:51 2022] DELETE /identity/v3/projects/899a23499b9c450fa77b8d635d071123 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:51.282268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a747cb-353f-4999-a088-2b89a4829d16 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.282543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a747cb-353f-4999-a088-2b89a4829d16 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.282843 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a747cb-353f-4999-a088-2b89a4829d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.305342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a7a747cb-353f-4999-a088-2b89a4829d16 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:51.306690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a7a747cb-353f-4999-a088-2b89a4829d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:51.383873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1218/2443] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:51.392858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9839ae-2fc8-4374-b173-7656ccedd137 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.393147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9839ae-2fc8-4374-b173-7656ccedd137 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.393641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9839ae-2fc8-4374-b173-7656ccedd137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.431596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ae9839ae-2fc8-4374-b173-7656ccedd137 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:51.434507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ae9839ae-2fc8-4374-b173-7656ccedd137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:51.454149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1226/2444] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:51.459297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a747cb-353f-4999-a088-2b89a4829d16 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:51.467530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:51.474807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a747cb-353f-4999-a088-2b89a4829d16 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:51.489021 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b9fe5-0b27-4b1a-8e42-d61d8cc392ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:51.490373 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b9fe5-0b27-4b1a-8e42-d61d8cc392ac admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.491360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b9fe5-0b27-4b1a-8e42-d61d8cc392ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.492517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b9fe5-0b27-4b1a-8e42-d61d8cc392ac admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.494913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b9fe5-0b27-4b1a-8e42-d61d8cc392ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:51.496484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b9fe5-0b27-4b1a-8e42-d61d8cc392ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:51.498202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b9fe5-0b27-4b1a-8e42-d61d8cc392ac admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:51.525053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1219/2445] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:49:51.529900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9839ae-2fc8-4374-b173-7656ccedd137 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:51.546796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9839ae-2fc8-4374-b173-7656ccedd137 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:51.553481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a37543-ba90-4821-9d60-1e724df2e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:51.554651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a37543-ba90-4821-9d60-1e724df2e384 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.571328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a37543-ba90-4821-9d60-1e724df2e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.571328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a37543-ba90-4821-9d60-1e724df2e384 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.575256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a37543-ba90-4821-9d60-1e724df2e384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:51.577478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a37543-ba90-4821-9d60-1e724df2e384 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:51.650459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1227/2446] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:51 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:51.656061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b9fe5-0b27-4b1a-8e42-d61d8cc392ac admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:51.672493 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b9fe5-0b27-4b1a-8e42-d61d8cc392ac admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:51.753073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb3009-a0a1-425e-8c60-70bbef271b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:51.756383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb3009-a0a1-425e-8c60-70bbef271b39 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.757722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb3009-a0a1-425e-8c60-70bbef271b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.757913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb3009-a0a1-425e-8c60-70bbef271b39 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.759632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb3009-a0a1-425e-8c60-70bbef271b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:51.762954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb3009-a0a1-425e-8c60-70bbef271b39 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:51.797685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1220/2447] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:51 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:51.803396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a37543-ba90-4821-9d60-1e724df2e384 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:51.825084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a37543-ba90-4821-9d60-1e724df2e384 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:51.830053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2842-cc42-4a19-bab1-e4cdaab491ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:51.830984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2842-cc42-4a19-bab1-e4cdaab491ee admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.831280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2842-cc42-4a19-bab1-e4cdaab491ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.831540 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2842-cc42-4a19-bab1-e4cdaab491ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.832186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2842-cc42-4a19-bab1-e4cdaab491ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:51.834482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2842-cc42-4a19-bab1-e4cdaab491ee admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:51.845801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1228/2448] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:51.850608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb3009-a0a1-425e-8c60-70bbef271b39 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:51.861316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb3009-a0a1-425e-8c60-70bbef271b39 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:51.866244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788ecb0-6ea7-4f31-9125-767c98a3528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:51.867006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788ecb0-6ea7-4f31-9125-767c98a3528d admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.867461 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788ecb0-6ea7-4f31-9125-767c98a3528d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.867892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788ecb0-6ea7-4f31-9125-767c98a3528d admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.868927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788ecb0-6ea7-4f31-9125-767c98a3528d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:51.871089 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788ecb0-6ea7-4f31-9125-767c98a3528d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:51.888759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1221/2449] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:51.893080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2842-cc42-4a19-bab1-e4cdaab491ee admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:51.904019 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2842-cc42-4a19-bab1-e4cdaab491ee admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:51.908684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77533b2-244d-4441-b7c7-cab9209d7f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:51.909345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77533b2-244d-4441-b7c7-cab9209d7f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.909622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77533b2-244d-4441-b7c7-cab9209d7f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.909896 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77533b2-244d-4441-b7c7-cab9209d7f42 admin admin] PATH_INFO: `/v3/projects/f31d0a5bb2d248b28690812295a5631c/users/106b1cd138cc4cacb8085497693df7ac/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.926899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77533b2-244d-4441-b7c7-cab9209d7f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31d0a5bb2d248b28690812295a5631c, user_id=106b1cd138cc4cacb8085497693df7ac, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:51.929756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77533b2-244d-4441-b7c7-cab9209d7f42 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:51.943134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1229/2450] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:51 2022] PUT /identity/v3/projects/f31d0a5bb2d248b28690812295a5631c/users/106b1cd138cc4cacb8085497693df7ac/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:51.953400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de9e60-4559-4719-bea9-6cc654536d6e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.953688 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de9e60-4559-4719-bea9-6cc654536d6e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.954042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de9e60-4559-4719-bea9-6cc654536d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.960606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1124d1a-4d1d-4397-9ab0-bd861d2c1a28 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:51.960924 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1124d1a-4d1d-4397-9ab0-bd861d2c1a28 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:51.961221 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1124d1a-4d1d-4397-9ab0-bd861d2c1a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:51.982798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a1124d1a-4d1d-4397-9ab0-bd861d2c1a28 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:51.984314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a1124d1a-4d1d-4397-9ab0-bd861d2c1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:51.984505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-62de9e60-4559-4719-bea9-6cc654536d6e None None] MFA Rules not processed for user `106b1cd138cc4cacb8085497693df7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:51.985690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-62de9e60-4559-4719-bea9-6cc654536d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:52.009567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:52.050518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1230/2451] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:52.058909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1222/2452] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:49:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:52.071717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1124d1a-4d1d-4397-9ab0-bd861d2c1a28 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:52.073112 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a1124d1a-4d1d-4397-9ab0-bd861d2c1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:52.074816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de9e60-4559-4719-bea9-6cc654536d6e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:52.076303 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-62de9e60-4559-4719-bea9-6cc654536d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:52.132236 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1124d1a-4d1d-4397-9ab0-bd861d2c1a28 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:52.136133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b106be-f316-46de-94d0-84d6532fa6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:52.136728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b106be-f316-46de-94d0-84d6532fa6df service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:52.137007 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b106be-f316-46de-94d0-84d6532fa6df service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:52.137276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b106be-f316-46de-94d0-84d6532fa6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:52.141831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:52.146650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b106be-f316-46de-94d0-84d6532fa6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:52.148114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b106be-f316-46de-94d0-84d6532fa6df service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:52.157108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1231/2453] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:52.161167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de9e60-4559-4719-bea9-6cc654536d6e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:52.168509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f943d30-4a05-4f0b-96a4-37cf39ab802c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:52.169128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f943d30-4a05-4f0b-96a4-37cf39ab802c service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:52.169408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f943d30-4a05-4f0b-96a4-37cf39ab802c service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:52.169681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f943d30-4a05-4f0b-96a4-37cf39ab802c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:52.179024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f943d30-4a05-4f0b-96a4-37cf39ab802c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:52.180623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f943d30-4a05-4f0b-96a4-37cf39ab802c service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:52.191963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1223/2454] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:49:57.154720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da18d9c-948f-4fbb-85af-e0b1a0f8e9ac None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:57.155351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da18d9c-948f-4fbb-85af-e0b1a0f8e9ac None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:57.155351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da18d9c-948f-4fbb-85af-e0b1a0f8e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:57.179518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-9da18d9c-948f-4fbb-85af-e0b1a0f8e9ac None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:57.180891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9da18d9c-948f-4fbb-85af-e0b1a0f8e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:57.189043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1232/2455] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:57.202523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f943d30-4a05-4f0b-96a4-37cf39ab802c service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:57.214042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f943d30-4a05-4f0b-96a4-37cf39ab802c service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:57.219714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d04d-92fa-497a-9046-34f85dba4a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:57.220314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d04d-92fa-497a-9046-34f85dba4a60 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:57.220595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d04d-92fa-497a-9046-34f85dba4a60 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:57.220868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d04d-92fa-497a-9046-34f85dba4a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:57.229619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476d04d-92fa-497a-9046-34f85dba4a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:57.231234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476d04d-92fa-497a-9046-34f85dba4a60 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:57.241466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1224/2456] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:01.323519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033ab6-24f0-4a12-9e69-aff5733263fb None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:01.324063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033ab6-24f0-4a12-9e69-aff5733263fb None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:01.324237 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033ab6-24f0-4a12-9e69-aff5733263fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:01.346027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-aa033ab6-24f0-4a12-9e69-aff5733263fb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:01.347386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-aa033ab6-24f0-4a12-9e69-aff5733263fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:01.356966 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1233/2457] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:01.384937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d04d-92fa-497a-9046-34f85dba4a60 service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:01.397986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d04d-92fa-497a-9046-34f85dba4a60 service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:01.404567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d987a4-c080-4a3f-8273-f56a5e2d501c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:01.405278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d987a4-c080-4a3f-8273-f56a5e2d501c service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:01.405636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d987a4-c080-4a3f-8273-f56a5e2d501c service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:01.405983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d987a4-c080-4a3f-8273-f56a5e2d501c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:01.415070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d987a4-c080-4a3f-8273-f56a5e2d501c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:01.416671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d987a4-c080-4a3f-8273-f56a5e2d501c service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:01.427715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1225/2458] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:02.837883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa033ab6-24f0-4a12-9e69-aff5733263fb None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:02.851963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa033ab6-24f0-4a12-9e69-aff5733263fb None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:02.857435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:02.858080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:02.858359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:02.859329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] PATH_INFO: `/v3/users/106b1cd138cc4cacb8085497693df7ac` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:02.860529 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106b1cd138cc4cacb8085497693df7ac)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:02.862619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:02.935752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106b1cd138cc4cacb8085497693df7ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:02.936700 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106b1cd138cc4cacb8085497693df7ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:02.952637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106b1cd138cc4cacb8085497693df7ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:02.960687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106b1cd138cc4cacb8085497693df7ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:02.961325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106b1cd138cc4cacb8085497693df7ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:02.974340 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1234/2459] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:50:02 2022] DELETE /identity/v3/users/106b1cd138cc4cacb8085497693df7ac => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:50:02.978837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0987e9-1dec-4c7e-8dfc-b951ec7a06d7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:02.979391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0987e9-1dec-4c7e-8dfc-b951ec7a06d7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:02.979391 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0987e9-1dec-4c7e-8dfc-b951ec7a06d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:02.999117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3c0987e9-1dec-4c7e-8dfc-b951ec7a06d7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:03.000359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3c0987e9-1dec-4c7e-8dfc-b951ec7a06d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:03.062566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1226/2460] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:03.073659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:03.075186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:03.116694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:03.143129 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c88005-bc48-4146-bc53-0a71922097a8 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:03.147860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77186e5e-cc41-4a52-b719-742eb8ce50f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:03.148587 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77186e5e-cc41-4a52-b719-742eb8ce50f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:03.149098 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77186e5e-cc41-4a52-b719-742eb8ce50f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:03.149364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77186e5e-cc41-4a52-b719-742eb8ce50f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:03.158851 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77186e5e-cc41-4a52-b719-742eb8ce50f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:03.160736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77186e5e-cc41-4a52-b719-742eb8ce50f8 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:03.171702 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1235/2461] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:03.528302 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0987e9-1dec-4c7e-8dfc-b951ec7a06d7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:03.529865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3c0987e9-1dec-4c7e-8dfc-b951ec7a06d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:03.544165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0987e9-1dec-4c7e-8dfc-b951ec7a06d7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:03.549573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:03.550244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:03.550595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:03.551040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] PATH_INFO: `/v3/projects/f31d0a5bb2d248b28690812295a5631c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:03.552807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31d0a5bb2d248b28690812295a5631c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:03.554858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:03.641400 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31d0a5bb2d248b28690812295a5631c', 'request_id': 'req-71e0e128-4226-4e91-83f6-509c3a60d8ae'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:03.648970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31d0a5bb2d248b28690812295a5631c', 'request_id': 'req-71e0e128-4226-4e91-83f6-509c3a60d8ae'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:03.658267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31d0a5bb2d248b28690812295a5631c', 'request_id': 'req-71e0e128-4226-4e91-83f6-509c3a60d8ae'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:03.670260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] The token cache is being invalidate because project f31d0a5bb2d248b28690812295a5631c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:50:03.670568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:03.671241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:03.672780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1227/2462] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:50:03 2022] DELETE /identity/v3/projects/f31d0a5bb2d248b28690812295a5631c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:50:06.576541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bd48-73b9-4fe4-ae7c-f9cbdcc7af18 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:06.577069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bd48-73b9-4fe4-ae7c-f9cbdcc7af18 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:06.577069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bd48-73b9-4fe4-ae7c-f9cbdcc7af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:06.600371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0c54bd48-73b9-4fe4-ae7c-f9cbdcc7af18 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:06.601626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0c54bd48-73b9-4fe4-ae7c-f9cbdcc7af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:06.667421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1236/2463] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:06.688018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:06.689754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:06.740937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:06.775539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0e128-4226-4e91-83f6-509c3a60d8ae admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:06.781723 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b26e98-be21-4d94-8081-95e74aee51d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:06.782341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b26e98-be21-4d94-8081-95e74aee51d1 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:06.782618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b26e98-be21-4d94-8081-95e74aee51d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:06.782927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b26e98-be21-4d94-8081-95e74aee51d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:06.792560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b26e98-be21-4d94-8081-95e74aee51d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:06.794116 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b26e98-be21-4d94-8081-95e74aee51d1 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:06.803873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1228/2464] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:50:10.791022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972df61-46ca-46e0-affb-7dde82ca57e4 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:10.792094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972df61-46ca-46e0-affb-7dde82ca57e4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:10.792538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972df61-46ca-46e0-affb-7dde82ca57e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:10.829054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f972df61-46ca-46e0-affb-7dde82ca57e4 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:10.830283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f972df61-46ca-46e0-affb-7dde82ca57e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:10.839590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1237/2465] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:50:10.857562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b26e98-be21-4d94-8081-95e74aee51d1 service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:10.858985 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-38b26e98-be21-4d94-8081-95e74aee51d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:10.876947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b26e98-be21-4d94-8081-95e74aee51d1 service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:10.884075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec68a74-c782-43ff-9c97-d0bd925f884f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:10.884678 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec68a74-c782-43ff-9c97-d0bd925f884f service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:10.884956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec68a74-c782-43ff-9c97-d0bd925f884f service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:10.885216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec68a74-c782-43ff-9c97-d0bd925f884f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:10.893920 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec68a74-c782-43ff-9c97-d0bd925f884f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:10.896145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec68a74-c782-43ff-9c97-d0bd925f884f service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:10.906757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1229/2466] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:11.980329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fc31f-7c35-4518-832a-9976144168f2 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:11.980810 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fc31f-7c35-4518-832a-9976144168f2 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:11.980930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fc31f-7c35-4518-832a-9976144168f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:12.001037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-156fc31f-7c35-4518-832a-9976144168f2 None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:12.002242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-156fc31f-7c35-4518-832a-9976144168f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:12.061116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1238/2467] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:50:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:12.101255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec68a74-c782-43ff-9c97-d0bd925f884f service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:12.102677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7ec68a74-c782-43ff-9c97-d0bd925f884f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:12.171658 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec68a74-c782-43ff-9c97-d0bd925f884f service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:12.178012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510165f-74e4-4720-9c26-9a1f6f32f9c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:12.178623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510165f-74e4-4720-9c26-9a1f6f32f9c0 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:12.178937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510165f-74e4-4720-9c26-9a1f6f32f9c0 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:12.179208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510165f-74e4-4720-9c26-9a1f6f32f9c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:12.187530 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510165f-74e4-4720-9c26-9a1f6f32f9c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:12.189105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510165f-74e4-4720-9c26-9a1f6f32f9c0 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:12.198034 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1230/2468] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:50:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:50:12.781724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505e69-8f66-45bd-ba11-a7dac926aef6 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:12.782075 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505e69-8f66-45bd-ba11-a7dac926aef6 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:12.782449 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505e69-8f66-45bd-ba11-a7dac926aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:12.803046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-7f505e69-8f66-45bd-ba11-a7dac926aef6 None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:12.804370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7f505e69-8f66-45bd-ba11-a7dac926aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:12.813269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1239/2469] 10.222.0.65 () {58 vars in 967 bytes} [Thu Aug 18 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:12.835960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510165f-74e4-4720-9c26-9a1f6f32f9c0 service swift] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:12.861355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510165f-74e4-4720-9c26-9a1f6f32f9c0 service swift] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:12.878482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec22fa-e218-4237-bb5e-a84816c37f61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:12.880812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec22fa-e218-4237-bb5e-a84816c37f61 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:12.881186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec22fa-e218-4237-bb5e-a84816c37f61 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:12.881755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec22fa-e218-4237-bb5e-a84816c37f61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:12.902097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec22fa-e218-4237-bb5e-a84816c37f61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:12.904429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec22fa-e218-4237-bb5e-a84816c37f61 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:12.917463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1231/2470] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:50:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:50:13.184295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1676043-ef98-41ac-bca1-96a5d349e9af None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:13.184770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1676043-ef98-41ac-bca1-96a5d349e9af None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:13.184903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1676043-ef98-41ac-bca1-96a5d349e9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:13.207220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e1676043-ef98-41ac-bca1-96a5d349e9af None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:13.208534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e1676043-ef98-41ac-bca1-96a5d349e9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:13.216055 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1240/2471] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:13.228273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec22fa-e218-4237-bb5e-a84816c37f61 service swift] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:13.239405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec22fa-e218-4237-bb5e-a84816c37f61 service swift] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:13.244444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f96f9-88c8-4a99-b0d6-531049523cda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:13.245052 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f96f9-88c8-4a99-b0d6-531049523cda service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:13.245312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f96f9-88c8-4a99-b0d6-531049523cda service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:13.245582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f96f9-88c8-4a99-b0d6-531049523cda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:13.253627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f96f9-88c8-4a99-b0d6-531049523cda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:13.255975 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f96f9-88c8-4a99-b0d6-531049523cda service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:13.264306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1232/2472] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:50:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:50:13.590598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2c90b-7c43-4645-890a-b4998733c221 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:13.590937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2c90b-7c43-4645-890a-b4998733c221 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:13.591214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2c90b-7c43-4645-890a-b4998733c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:13.610717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-63e2c90b-7c43-4645-890a-b4998733c221 None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:13.611857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-63e2c90b-7c43-4645-890a-b4998733c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:13.619592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1241/2473] 10.222.0.65 () {58 vars in 967 bytes} [Thu Aug 18 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:13.631765 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f96f9-88c8-4a99-b0d6-531049523cda service swift] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:13.642814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f96f9-88c8-4a99-b0d6-531049523cda service swift] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:13.647835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ac7c8-5197-42fa-ba7d-d901a456c3c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:13.648417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ac7c8-5197-42fa-ba7d-d901a456c3c9 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:13.648690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ac7c8-5197-42fa-ba7d-d901a456c3c9 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:13.648957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ac7c8-5197-42fa-ba7d-d901a456c3c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:13.657916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ac7c8-5197-42fa-ba7d-d901a456c3c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:13.659834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ac7c8-5197-42fa-ba7d-d901a456c3c9 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:13.668262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1233/2474] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:50:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:50:15.867056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2c90b-7c43-4645-890a-b4998733c221 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:15.868485 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-63e2c90b-7c43-4645-890a-b4998733c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:15.883800 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2c90b-7c43-4645-890a-b4998733c221 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:15.888374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:15.889101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:15.889382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:15.889650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] PATH_INFO: `/v3/users/244fcebee5bf41fcb9c30e1b4019bd97` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:15.890973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] RBAC: Authorizing `identity:delete_user(user_id=244fcebee5bf41fcb9c30e1b4019bd97)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:15.892731 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:15.942132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244fcebee5bf41fcb9c30e1b4019bd97'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:15.942821 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244fcebee5bf41fcb9c30e1b4019bd97'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:15.944012 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:15.956302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244fcebee5bf41fcb9c30e1b4019bd97'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:15.964464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244fcebee5bf41fcb9c30e1b4019bd97'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:15.965183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244fcebee5bf41fcb9c30e1b4019bd97'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:15.977792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1242/2475] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:50:15 2022] DELETE /identity/v3/users/244fcebee5bf41fcb9c30e1b4019bd97 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:50:15.982412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb21d8f-e414-48fb-a0c4-725c4f1e3cc2 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:15.983038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb21d8f-e414-48fb-a0c4-725c4f1e3cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:15.983038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb21d8f-e414-48fb-a0c4-725c4f1e3cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:16.001716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ffb21d8f-e414-48fb-a0c4-725c4f1e3cc2 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:16.002961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ffb21d8f-e414-48fb-a0c4-725c4f1e3cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:16.062705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1234/2476] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:16.073164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:16.074565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:16.131814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4fcbf-d6a9-41ec-b594-23c5f76f803e admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:16.135767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d988-67cf-4e62-876c-ad6b56d51239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:16.136368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d988-67cf-4e62-876c-ad6b56d51239 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:16.136644 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d988-67cf-4e62-876c-ad6b56d51239 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:16.136914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d988-67cf-4e62-876c-ad6b56d51239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:16.146282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0d988-67cf-4e62-876c-ad6b56d51239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:16.147737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0d988-67cf-4e62-876c-ad6b56d51239 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:16.157255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1243/2477] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:16.338254 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb21d8f-e414-48fb-a0c4-725c4f1e3cc2 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:16.339773 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ffb21d8f-e414-48fb-a0c4-725c4f1e3cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:16.349715 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:16.353441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb21d8f-e414-48fb-a0c4-725c4f1e3cc2 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:16.361120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:16.361932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:16.362375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:16.362828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] PATH_INFO: `/v3/projects/8c57f13cfd474d81af57e91ec3ccb0d2` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:16.365381 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c57f13cfd474d81af57e91ec3ccb0d2)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:16.367908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:16.433649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c57f13cfd474d81af57e91ec3ccb0d2', 'request_id': 'req-4701bec6-ddda-410d-b116-f45ae60e1f21'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:16.440170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c57f13cfd474d81af57e91ec3ccb0d2', 'request_id': 'req-4701bec6-ddda-410d-b116-f45ae60e1f21'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:16.448850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c57f13cfd474d81af57e91ec3ccb0d2', 'request_id': 'req-4701bec6-ddda-410d-b116-f45ae60e1f21'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:16.459849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] The token cache is being invalidate because project 8c57f13cfd474d81af57e91ec3ccb0d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:50:16.460133 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:16.460758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4701bec6-ddda-410d-b116-f45ae60e1f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:50:16.462238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1235/2478] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:50:16 2022] DELETE /identity/v3/projects/8c57f13cfd474d81af57e91ec3ccb0d2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:50:22.976930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d988-67cf-4e62-876c-ad6b56d51239 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:22.985645 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d988-67cf-4e62-876c-ad6b56d51239 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:23.038332 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:23.038978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:23.039260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:23.039535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:23.041284 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:23.110372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:23.111861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:23.123076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1244/2479] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:26.456842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:27.553259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b532-8e69-4061-b2f4-254ea86d5bcb None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:27.553851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b532-8e69-4061-b2f4-254ea86d5bcb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:27.553851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b532-8e69-4061-b2f4-254ea86d5bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:27.574023 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-75c9b532-8e69-4061-b2f4-254ea86d5bcb None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:27.575299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-75c9b532-8e69-4061-b2f4-254ea86d5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:27.633057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1236/2480] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:50:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:27.646352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:27.647806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:27.654614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf105-ef02-4b50-8278-0742b521547c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:27.654961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf105-ef02-4b50-8278-0742b521547c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:27.655266 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf105-ef02-4b50-8278-0742b521547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:27.670950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:27.674947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-242cf105-ef02-4b50-8278-0742b521547c None None] MFA Rules not processed for user `a5399e7179fe43a1826473d83e8e5c16`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:27.676732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-242cf105-ef02-4b50-8278-0742b521547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:27.727923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f1ddc-c3f4-436b-8a98-d0b1b713b055 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:27.732973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7823fe-833d-40a9-a0d6-913b0238388a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:27.733620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7823fe-833d-40a9-a0d6-913b0238388a service swift] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:27.733899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7823fe-833d-40a9-a0d6-913b0238388a service swift] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:27.734179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7823fe-833d-40a9-a0d6-913b0238388a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:27.735576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1237/2481] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:50:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:50:27.743927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7823fe-833d-40a9-a0d6-913b0238388a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:27.745792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7823fe-833d-40a9-a0d6-913b0238388a service swift] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:27.755385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1245/2482] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:50:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:50:37.728754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=50 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:37.751063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=24 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:40.014339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf105-ef02-4b50-8278-0742b521547c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:40.016004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-242cf105-ef02-4b50-8278-0742b521547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:40.094950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf105-ef02-4b50-8278-0742b521547c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:40.100945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42b67a-7bcd-45c4-981d-4e6b3e13a25c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:40.101603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42b67a-7bcd-45c4-981d-4e6b3e13a25c service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:40.101921 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42b67a-7bcd-45c4-981d-4e6b3e13a25c service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:40.102200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42b67a-7bcd-45c4-981d-4e6b3e13a25c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:40.104269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9c42b67a-7bcd-45c4-981d-4e6b3e13a25c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:40.117456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42b67a-7bcd-45c4-981d-4e6b3e13a25c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:40.119258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42b67a-7bcd-45c4-981d-4e6b3e13a25c service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:40.129600 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1238/2483] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:42.059750 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688bfb6-115b-4b67-b816-43cce29d5704 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:42.060382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688bfb6-115b-4b67-b816-43cce29d5704 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:42.060382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688bfb6-115b-4b67-b816-43cce29d5704 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:42.061638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1246/2484] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:50:42.068410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13dd33-c1eb-4a77-a189-a4eb41769f01 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:42.068937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13dd33-c1eb-4a77-a189-a4eb41769f01 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:42.068937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13dd33-c1eb-4a77-a189-a4eb41769f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:42.092293 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9a13dd33-c1eb-4a77-a189-a4eb41769f01 None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:42.093525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9a13dd33-c1eb-4a77-a189-a4eb41769f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:42.173729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1239/2485] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:42.188894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688bfb6-115b-4b67-b816-43cce29d5704 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:42.192779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8688bfb6-115b-4b67-b816-43cce29d5704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:42.265062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688bfb6-115b-4b67-b816-43cce29d5704 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:42.269610 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751df37-dc4b-45d9-a626-97d8103c3e94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d4e9baa7a6241b1807c67844c7d424c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:42.270614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751df37-dc4b-45d9-a626-97d8103c3e94 service glance] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:42.271121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751df37-dc4b-45d9-a626-97d8103c3e94 service glance] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:42.271586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751df37-dc4b-45d9-a626-97d8103c3e94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:42.288990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751df37-dc4b-45d9-a626-97d8103c3e94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:42.290450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751df37-dc4b-45d9-a626-97d8103c3e94 service glance] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:42.303981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1247/2486] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:42.382521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7b135-ed3f-40b6-8982-c29f14ab623b None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:42.383355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7b135-ed3f-40b6-8982-c29f14ab623b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:42.383628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7b135-ed3f-40b6-8982-c29f14ab623b None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:42.384973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1240/2487] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:50:42.390136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1be733-4548-461e-9e33-3c4240143b9c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:42.390562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1be733-4548-461e-9e33-3c4240143b9c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:42.390986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1be733-4548-461e-9e33-3c4240143b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:42.412713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-ce1be733-4548-461e-9e33-3c4240143b9c None None] MFA Rules not processed for user `c13c571a4bd24335b8b149825bd79d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:42.413935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ce1be733-4548-461e-9e33-3c4240143b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:42.421070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1248/2488] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:42.432930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7b135-ed3f-40b6-8982-c29f14ab623b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:42.435420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d5b7b135-ed3f-40b6-8982-c29f14ab623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:42.462645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7b135-ed3f-40b6-8982-c29f14ab623b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:42.467100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe98f1-de86-4ecb-9740-55d9228a7a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:42.467885 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe98f1-de86-4ecb-9740-55d9228a7a4a service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:42.468325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe98f1-de86-4ecb-9740-55d9228a7a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:42.468760 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe98f1-de86-4ecb-9740-55d9228a7a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:42.477897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe98f1-de86-4ecb-9740-55d9228a7a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:42.479645 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe98f1-de86-4ecb-9740-55d9228a7a4a service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:42.501584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1241/2489] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:42.611259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5d1d9-fa6c-4011-bf80-b707276c52bf None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:42.611581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5d1d9-fa6c-4011-bf80-b707276c52bf None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:42.611793 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5d1d9-fa6c-4011-bf80-b707276c52bf None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:42.613634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1249/2490] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:50:42.621090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321ec85-4cb2-4110-9cc1-00253d4e01eb None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:42.621369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321ec85-4cb2-4110-9cc1-00253d4e01eb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:42.621639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321ec85-4cb2-4110-9cc1-00253d4e01eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:42.644098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c321ec85-4cb2-4110-9cc1-00253d4e01eb None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:42.645337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c321ec85-4cb2-4110-9cc1-00253d4e01eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:42.656595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1242/2491] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:42.671259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5d1d9-fa6c-4011-bf80-b707276c52bf None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:42.691023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5d1d9-fa6c-4011-bf80-b707276c52bf None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:42.695954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e702-1bf9-4133-aa56-a7d8919a6f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:42.696583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e702-1bf9-4133-aa56-a7d8919a6f10 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:42.696891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e702-1bf9-4133-aa56-a7d8919a6f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:42.697159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e702-1bf9-4133-aa56-a7d8919a6f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:42.710884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004e702-1bf9-4133-aa56-a7d8919a6f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:42.712512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004e702-1bf9-4133-aa56-a7d8919a6f10 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:42.725585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1250/2492] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:45.320881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323767a-cd9c-4673-9c82-b7b886447cd5 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:45.321454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323767a-cd9c-4673-9c82-b7b886447cd5 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:45.321454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323767a-cd9c-4673-9c82-b7b886447cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:45.340618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7323767a-cd9c-4673-9c82-b7b886447cd5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:45.341828 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7323767a-cd9c-4673-9c82-b7b886447cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:45.416258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1243/2493] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:45.430831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e702-1bf9-4133-aa56-a7d8919a6f10 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:45.432436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9004e702-1bf9-4133-aa56-a7d8919a6f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:45.448161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e702-1bf9-4133-aa56-a7d8919a6f10 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:45.454023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f620e-3ea8-4d62-abe7-f3cf71e1831e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:45.454642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f620e-3ea8-4d62-abe7-f3cf71e1831e service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:45.454955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f620e-3ea8-4d62-abe7-f3cf71e1831e service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:45.455231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f620e-3ea8-4d62-abe7-f3cf71e1831e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:45.464338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f620e-3ea8-4d62-abe7-f3cf71e1831e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:45.465965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f620e-3ea8-4d62-abe7-f3cf71e1831e service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:45.476676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1251/2494] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:47.204390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ab1c8-bd81-4a22-9d59-6bcc67dab2f5 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:47.205108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ab1c8-bd81-4a22-9d59-6bcc67dab2f5 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:47.205108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ab1c8-bd81-4a22-9d59-6bcc67dab2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:47.212866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:47.226369 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ff4ab1c8-bd81-4a22-9d59-6bcc67dab2f5 None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:47.227637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ff4ab1c8-bd81-4a22-9d59-6bcc67dab2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:47.234735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1244/2495] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:50:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:47.247426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f620e-3ea8-4d62-abe7-f3cf71e1831e service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:47.261082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f620e-3ea8-4d62-abe7-f3cf71e1831e service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:47.266322 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba0f91-98be-4ac4-99a0-6cb74ae1bcce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:47.266958 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba0f91-98be-4ac4-99a0-6cb74ae1bcce service swift] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:47.267239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba0f91-98be-4ac4-99a0-6cb74ae1bcce service swift] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:47.267515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba0f91-98be-4ac4-99a0-6cb74ae1bcce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:47.276413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba0f91-98be-4ac4-99a0-6cb74ae1bcce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:47.278280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba0f91-98be-4ac4-99a0-6cb74ae1bcce service swift] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:47.290445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1252/2496] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:50:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:50:48.628912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d9041-b3d0-4b12-8e05-2120bd949f14 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:48.629566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d9041-b3d0-4b12-8e05-2120bd949f14 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:48.629566 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d9041-b3d0-4b12-8e05-2120bd949f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:48.649793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-813d9041-b3d0-4b12-8e05-2120bd949f14 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:50:48.651039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-813d9041-b3d0-4b12-8e05-2120bd949f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:50:48.659507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1245/2497] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:50:48.675395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba0f91-98be-4ac4-99a0-6cb74ae1bcce service swift] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:50:48.687624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba0f91-98be-4ac4-99a0-6cb74ae1bcce service swift] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:50:48.692955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f26d2-049f-4e63-8d4b-27f500b661a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:50:48.693562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f26d2-049f-4e63-8d4b-27f500b661a8 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:50:48.693866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f26d2-049f-4e63-8d4b-27f500b661a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:50:48.694134 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f26d2-049f-4e63-8d4b-27f500b661a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:50:48.702317 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f26d2-049f-4e63-8d4b-27f500b661a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:50:48.703937 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f26d2-049f-4e63-8d4b-27f500b661a8 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:50:48.714083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1253/2498] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:50:58.645110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:50:58.709723 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=53 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:05.164816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6f150-160f-498d-b2ce-6fd2d9cb6175 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:05.166001 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6f150-160f-498d-b2ce-6fd2d9cb6175 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:05.166442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6f150-160f-498d-b2ce-6fd2d9cb6175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:05.214100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ebf6f150-160f-498d-b2ce-6fd2d9cb6175 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:05.215529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ebf6f150-160f-498d-b2ce-6fd2d9cb6175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:05.225336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1246/2499] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:05.379861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f26d2-049f-4e63-8d4b-27f500b661a8 service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:05.395375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f26d2-049f-4e63-8d4b-27f500b661a8 service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:05.401053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390dfd7-f6bd-412c-9594-c47a6fe2e31d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:05.401682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390dfd7-f6bd-412c-9594-c47a6fe2e31d service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:05.401960 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390dfd7-f6bd-412c-9594-c47a6fe2e31d service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:05.402231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390dfd7-f6bd-412c-9594-c47a6fe2e31d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:05.411076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390dfd7-f6bd-412c-9594-c47a6fe2e31d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:05.412599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390dfd7-f6bd-412c-9594-c47a6fe2e31d service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:05.422480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1254/2500] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:08.410973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7437f-c02d-4e1b-9ed2-d00af4b62b38 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:08.411532 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7437f-c02d-4e1b-9ed2-d00af4b62b38 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:08.411689 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7437f-c02d-4e1b-9ed2-d00af4b62b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:08.431122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b0b7437f-c02d-4e1b-9ed2-d00af4b62b38 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:08.432341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b0b7437f-c02d-4e1b-9ed2-d00af4b62b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:08.441427 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1247/2501] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:08.456902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390dfd7-f6bd-412c-9594-c47a6fe2e31d service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:08.468207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390dfd7-f6bd-412c-9594-c47a6fe2e31d service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:08.473657 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c891a1b-049f-47bf-994b-242128543710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:08.474250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c891a1b-049f-47bf-994b-242128543710 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:08.474529 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c891a1b-049f-47bf-994b-242128543710 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:08.474829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c891a1b-049f-47bf-994b-242128543710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:08.483478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c891a1b-049f-47bf-994b-242128543710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:08.485052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c891a1b-049f-47bf-994b-242128543710 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:08.495020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1255/2502] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:11.066789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88911c-4060-47d5-8bd1-ad729e83664c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:11.067249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88911c-4060-47d5-8bd1-ad729e83664c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:11.067390 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88911c-4060-47d5-8bd1-ad729e83664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:11.088319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4b88911c-4060-47d5-8bd1-ad729e83664c None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:11.089657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4b88911c-4060-47d5-8bd1-ad729e83664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:11.098309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1248/2503] 10.222.0.65 () {58 vars in 967 bytes} [Thu Aug 18 20:51:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:11.110761 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c891a1b-049f-47bf-994b-242128543710 service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:11.121895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c891a1b-049f-47bf-994b-242128543710 service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:11.127285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b3138-c87b-4959-a406-a4f5138c2d26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:11.127917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b3138-c87b-4959-a406-a4f5138c2d26 service swift] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:11.128202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b3138-c87b-4959-a406-a4f5138c2d26 service swift] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:11.128472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b3138-c87b-4959-a406-a4f5138c2d26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:11.137277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b3138-c87b-4959-a406-a4f5138c2d26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:11.138898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b3138-c87b-4959-a406-a4f5138c2d26 service swift] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:11.147733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1256/2504] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:51:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:51:13.654411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c9c6-409a-4cd0-815e-e7fe33a4be4e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:13.655121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c9c6-409a-4cd0-815e-e7fe33a4be4e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:13.655121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c9c6-409a-4cd0-815e-e7fe33a4be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:13.675808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0773c9c6-409a-4cd0-815e-e7fe33a4be4e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:13.677165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0773c9c6-409a-4cd0-815e-e7fe33a4be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:13.685248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1249/2505] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 18 20:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:13.701286 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b3138-c87b-4959-a406-a4f5138c2d26 service swift] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:13.702877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b60b3138-c87b-4959-a406-a4f5138c2d26 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:13.718517 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b3138-c87b-4959-a406-a4f5138c2d26 service swift] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:13.725026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2dbdc-7d87-4873-97cb-a9efb4287afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:13.725566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2dbdc-7d87-4873-97cb-a9efb4287afd service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:13.725835 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2dbdc-7d87-4873-97cb-a9efb4287afd service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:13.726107 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2dbdc-7d87-4873-97cb-a9efb4287afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:13.734474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2dbdc-7d87-4873-97cb-a9efb4287afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:13.736912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2dbdc-7d87-4873-97cb-a9efb4287afd service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:13.747222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1257/2506] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:15.237891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49628b-60ab-4393-8797-21c28cf5686c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:15.238755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49628b-60ab-4393-8797-21c28cf5686c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:15.239282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49628b-60ab-4393-8797-21c28cf5686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:15.258879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3d49628b-60ab-4393-8797-21c28cf5686c None None] MFA Rules not processed for user `352a102f604048138df5a31bab4f8cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:15.260080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3d49628b-60ab-4393-8797-21c28cf5686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:15.316561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1250/2507] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:51:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:23.744434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=24 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:25.309318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=37 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:27.076080 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798e2f6-91a1-4aaa-997e-9182ff8a36ec None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:27.076668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798e2f6-91a1-4aaa-997e-9182ff8a36ec None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:27.076668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798e2f6-91a1-4aaa-997e-9182ff8a36ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:27.100079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e798e2f6-91a1-4aaa-997e-9182ff8a36ec None None] MFA Rules not processed for user `5d210b7348594c3da477a1b6b77dfb34`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:27.101681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e798e2f6-91a1-4aaa-997e-9182ff8a36ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:27.165590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1258/2508] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:51:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:37.158171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=25 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:43.502956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3737e-bf3d-49aa-825a-7fedf6f61516 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.503543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3737e-bf3d-49aa-825a-7fedf6f61516 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.503852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3737e-bf3d-49aa-825a-7fedf6f61516 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.505379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1251/2509] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:43.538858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda05081-360b-40c7-a17a-c97ecfd5cab4 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.539433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda05081-360b-40c7-a17a-c97ecfd5cab4 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.539624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda05081-360b-40c7-a17a-c97ecfd5cab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.561856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-eda05081-360b-40c7-a17a-c97ecfd5cab4 None None] MFA Rules not processed for user `be696635db224e3a868957eb5b5bae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:43.563759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-eda05081-360b-40c7-a17a-c97ecfd5cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:43.580460 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3737e-bf3d-49aa-825a-7fedf6f61516 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:43.581149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1259/2510] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:51:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:51:43.582418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c8b3737e-bf3d-49aa-825a-7fedf6f61516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:43.604697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda05081-360b-40c7-a17a-c97ecfd5cab4 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:43.606160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-eda05081-360b-40c7-a17a-c97ecfd5cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:43.614368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3737e-bf3d-49aa-825a-7fedf6f61516 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:43.620331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda05081-360b-40c7-a17a-c97ecfd5cab4 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:43.621264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:43.621935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.622172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.622444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] PATH_INFO: `/v3/users/a5399e7179fe43a1826473d83e8e5c16` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.623602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5399e7179fe43a1826473d83e8e5c16)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:43.625708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:43.626581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a464a8-e1a2-41da-91bb-9837f31f2aca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:43.627266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a464a8-e1a2-41da-91bb-9837f31f2aca service placement] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.627605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a464a8-e1a2-41da-91bb-9837f31f2aca service placement] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.628036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a464a8-e1a2-41da-91bb-9837f31f2aca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.637696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a464a8-e1a2-41da-91bb-9837f31f2aca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:43.639336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a464a8-e1a2-41da-91bb-9837f31f2aca service placement] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:43.651079 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1260/2511] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:43.698441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5399e7179fe43a1826473d83e8e5c16'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:43.706300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5399e7179fe43a1826473d83e8e5c16'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:43.714379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5399e7179fe43a1826473d83e8e5c16'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:43.728865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5399e7179fe43a1826473d83e8e5c16'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:43.729599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-a25aa1ea-332d-4543-90a2-285ac2c4c4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5399e7179fe43a1826473d83e8e5c16'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:43.738376 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1252/2512] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:51:43 2022] DELETE /identity/v3/users/a5399e7179fe43a1826473d83e8e5c16 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:51:43.919682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a464a8-e1a2-41da-91bb-9837f31f2aca service placement] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:43.933777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a464a8-e1a2-41da-91bb-9837f31f2aca service placement] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:43.992676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:43.993308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.993600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.993855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] PATH_INFO: `/v3/projects/112bd465eb73460bb1ca48ec85e96748` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.994994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112bd465eb73460bb1ca48ec85e96748)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:43.996917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:44.044487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112bd465eb73460bb1ca48ec85e96748', 'request_id': 'req-ea835dc6-f570-4ab8-be84-2af4d6e691b3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:44.050358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112bd465eb73460bb1ca48ec85e96748', 'request_id': 'req-ea835dc6-f570-4ab8-be84-2af4d6e691b3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:44.057829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112bd465eb73460bb1ca48ec85e96748', 'request_id': 'req-ea835dc6-f570-4ab8-be84-2af4d6e691b3'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:44.069063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] The token cache is being invalidate because project 112bd465eb73460bb1ca48ec85e96748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:51:44.069351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:44.069998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea835dc6-f570-4ab8-be84-2af4d6e691b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:51:44.071532 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1261/2513] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:51:43 2022] DELETE /identity/v3/projects/112bd465eb73460bb1ca48ec85e96748 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:51:53.606035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdc969-b6c3-4d3b-a6c9-560b8141b320 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.606594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdc969-b6c3-4d3b-a6c9-560b8141b320 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.606594 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdc969-b6c3-4d3b-a6c9-560b8141b320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.627347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fffdc969-b6c3-4d3b-a6c9-560b8141b320 None None] MFA Rules not processed for user `40c7c0ae1660404b8ec1e3eae0eb92e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:53.628818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fffdc969-b6c3-4d3b-a6c9-560b8141b320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:53.685135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1253/2514] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:54.066059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:03.678314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:22.509054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09869d9c-2c2c-439f-bd39-1c3913b4c126 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.509566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09869d9c-2c2c-439f-bd39-1c3913b4c126 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.509664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09869d9c-2c2c-439f-bd39-1c3913b4c126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.530672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-09869d9c-2c2c-439f-bd39-1c3913b4c126 None None] MFA Rules not processed for user `352a102f604048138df5a31bab4f8cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:22.532015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-09869d9c-2c2c-439f-bd39-1c3913b4c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:22.588707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1262/2515] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:28.904273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdc969-b6c3-4d3b-a6c9-560b8141b320 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:28.906192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fffdc969-b6c3-4d3b-a6c9-560b8141b320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:28.992179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdc969-b6c3-4d3b-a6c9-560b8141b320 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:28.996782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:28.997424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:28.997734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:28.998006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] PATH_INFO: `/v3/users/5d210b7348594c3da477a1b6b77dfb34` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:28.999173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d210b7348594c3da477a1b6b77dfb34)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.001185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.051744 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d210b7348594c3da477a1b6b77dfb34'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.059166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d210b7348594c3da477a1b6b77dfb34'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.068382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d210b7348594c3da477a1b6b77dfb34'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.083494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d210b7348594c3da477a1b6b77dfb34'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.084203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c591b29f-4f94-498c-84e4-dc2d0dcfb2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d210b7348594c3da477a1b6b77dfb34'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.090426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1254/2516] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:52:28 2022] DELETE /identity/v3/users/5d210b7348594c3da477a1b6b77dfb34 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:29.266318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09869d9c-2c2c-439f-bd39-1c3913b4c126 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.279258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09869d9c-2c2c-439f-bd39-1c3913b4c126 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.352720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.354032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.355077 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.355577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] PATH_INFO: `/v3/projects/e59d418003f246b484b97189069c1fb6` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.357527 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59d418003f246b484b97189069c1fb6)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.361416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.425756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59d418003f246b484b97189069c1fb6', 'request_id': 'req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.432297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59d418003f246b484b97189069c1fb6', 'request_id': 'req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.443472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59d418003f246b484b97189069c1fb6', 'request_id': 'req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.460158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] The token cache is being invalidate because project e59d418003f246b484b97189069c1fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:52:29.460364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.461122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-7ddcc619-87d9-4b55-ad25-b3b8bf76fe06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:29.462699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1263/2517] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:52:29 2022] DELETE /identity/v3/projects/e59d418003f246b484b97189069c1fb6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:29.473643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa4fe4-3c77-4e91-80d0-144bf2d0dbf3 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.473932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa4fe4-3c77-4e91-80d0-144bf2d0dbf3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.474207 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa4fe4-3c77-4e91-80d0-144bf2d0dbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.494545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a3fa4fe4-3c77-4e91-80d0-144bf2d0dbf3 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:29.495850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a3fa4fe4-3c77-4e91-80d0-144bf2d0dbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:29.556078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1255/2518] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:29.564565 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f5a75-1f67-4d84-850f-66f421ef07b6 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.565105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f5a75-1f67-4d84-850f-66f421ef07b6 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.565386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f5a75-1f67-4d84-850f-66f421ef07b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.587965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c96f5a75-1f67-4d84-850f-66f421ef07b6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:29.589175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c96f5a75-1f67-4d84-850f-66f421ef07b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:29.597727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1264/2519] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:29.602020 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa4fe4-3c77-4e91-80d0-144bf2d0dbf3 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.611867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa4fe4-3c77-4e91-80d0-144bf2d0dbf3 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.616488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff011-b3ed-4880-be34-3bc254e06b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.617080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff011-b3ed-4880-be34-3bc254e06b9d admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.617357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff011-b3ed-4880-be34-3bc254e06b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.617624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff011-b3ed-4880-be34-3bc254e06b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.618277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff011-b3ed-4880-be34-3bc254e06b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:29.618573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff011-b3ed-4880-be34-3bc254e06b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.620213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff011-b3ed-4880-be34-3bc254e06b9d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.633498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1256/2520] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:29.638033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f5a75-1f67-4d84-850f-66f421ef07b6 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.648816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f5a75-1f67-4d84-850f-66f421ef07b6 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.653467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e28a4-2be4-4c2f-bad7-103aaac02318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.654207 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e28a4-2be4-4c2f-bad7-103aaac02318 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.654690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e28a4-2be4-4c2f-bad7-103aaac02318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.654999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e28a4-2be4-4c2f-bad7-103aaac02318 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.655655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e28a4-2be4-4c2f-bad7-103aaac02318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.657732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e28a4-2be4-4c2f-bad7-103aaac02318 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.686194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1265/2521] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:52:29 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:29.690596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff011-b3ed-4880-be34-3bc254e06b9d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.700769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff011-b3ed-4880-be34-3bc254e06b9d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.704459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:29.761837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1049559-8745-4d66-a059-2a946e4638f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.762363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1049559-8745-4d66-a059-2a946e4638f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.762646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1049559-8745-4d66-a059-2a946e4638f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.762954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1049559-8745-4d66-a059-2a946e4638f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.764035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1049559-8745-4d66-a059-2a946e4638f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.765977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1049559-8745-4d66-a059-2a946e4638f5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.786954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1257/2522] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:52:29 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:29.791092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e28a4-2be4-4c2f-bad7-103aaac02318 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.801703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e28a4-2be4-4c2f-bad7-103aaac02318 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.806257 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b24af2-2589-4fb5-bf30-76c6be75a122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.806876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24af2-2589-4fb5-bf30-76c6be75a122 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.807149 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24af2-2589-4fb5-bf30-76c6be75a122 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.807413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24af2-2589-4fb5-bf30-76c6be75a122 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.808038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b24af2-2589-4fb5-bf30-76c6be75a122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.809614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b24af2-2589-4fb5-bf30-76c6be75a122 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.811489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:29.821852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1266/2523] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:52:29.825948 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1049559-8745-4d66-a059-2a946e4638f5 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.836869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1049559-8745-4d66-a059-2a946e4638f5 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.841698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291a98f-3b25-42d6-8a4e-033d1ba5b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.842439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a98f-3b25-42d6-8a4e-033d1ba5b71a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.842723 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a98f-3b25-42d6-8a4e-033d1ba5b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.843033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a98f-3b25-42d6-8a4e-033d1ba5b71a admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.843679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291a98f-3b25-42d6-8a4e-033d1ba5b71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.845283 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291a98f-3b25-42d6-8a4e-033d1ba5b71a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.856104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1258/2524] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:52:29.861185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b24af2-2589-4fb5-bf30-76c6be75a122 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.871238 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b24af2-2589-4fb5-bf30-76c6be75a122 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.876742 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea3c34-5f0a-4a57-a958-303812c7cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.877407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea3c34-5f0a-4a57-a958-303812c7cff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.877683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea3c34-5f0a-4a57-a958-303812c7cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.877976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea3c34-5f0a-4a57-a958-303812c7cff8 admin admin] PATH_INFO: `/v3/projects/b5d170987dfd4ae58f6c73f6f66f6a53/users/4764248dc1a14c608157d601a23ba6ff/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.893140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea3c34-5f0a-4a57-a958-303812c7cff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d170987dfd4ae58f6c73f6f66f6a53, user_id=4764248dc1a14c608157d601a23ba6ff, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.895826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea3c34-5f0a-4a57-a958-303812c7cff8 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.909166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1267/2525] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:29 2022] PUT /identity/v3/projects/b5d170987dfd4ae58f6c73f6f66f6a53/users/4764248dc1a14c608157d601a23ba6ff/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:29.914141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92630682-5c53-45b0-afe6-8b4a680c4a0a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.914680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92630682-5c53-45b0-afe6-8b4a680c4a0a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.914680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92630682-5c53-45b0-afe6-8b4a680c4a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.934871 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-92630682-5c53-45b0-afe6-8b4a680c4a0a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:29.937326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-92630682-5c53-45b0-afe6-8b4a680c4a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:30.000554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1259/2526] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:30.010595 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea3c34-5f0a-4a57-a958-303812c7cff8 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.012375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a0ea3c34-5f0a-4a57-a958-303812c7cff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:30.072086 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea3c34-5f0a-4a57-a958-303812c7cff8 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:30.076265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921d4b-bba2-40f3-bbff-85c93863cdf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:30.076879 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921d4b-bba2-40f3-bbff-85c93863cdf8 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.077159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921d4b-bba2-40f3-bbff-85c93863cdf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.077427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921d4b-bba2-40f3-bbff-85c93863cdf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.086487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e921d4b-bba2-40f3-bbff-85c93863cdf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:30.087934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e921d4b-bba2-40f3-bbff-85c93863cdf8 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:30.098492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1268/2527] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:30.939359 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9e9d9-17b7-479e-a657-bb84eba25d09 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.939834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9e9d9-17b7-479e-a657-bb84eba25d09 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.939953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9e9d9-17b7-479e-a657-bb84eba25d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.971069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-47e9e9d9-17b7-479e-a657-bb84eba25d09 None None] MFA Rules not processed for user `4764248dc1a14c608157d601a23ba6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:30.972215 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-47e9e9d9-17b7-479e-a657-bb84eba25d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:31.041960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1260/2528] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:31.047341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921d4b-bba2-40f3-bbff-85c93863cdf8 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.057071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921d4b-bba2-40f3-bbff-85c93863cdf8 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.062178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c26b2-6f1e-4f0f-bc83-5e1c51e0802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.062862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c26b2-6f1e-4f0f-bc83-5e1c51e0802e admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.063083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c26b2-6f1e-4f0f-bc83-5e1c51e0802e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.063354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c26b2-6f1e-4f0f-bc83-5e1c51e0802e admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.063975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c26b2-6f1e-4f0f-bc83-5e1c51e0802e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.065943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c26b2-6f1e-4f0f-bc83-5e1c51e0802e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.100522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1269/2529] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:52:31 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:31.101917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9e9d9-17b7-479e-a657-bb84eba25d09 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.113269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9e9d9-17b7-479e-a657-bb84eba25d09 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.125279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.186123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1f354-23d6-45ed-ba47-84237784f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.186857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f354-23d6-45ed-ba47-84237784f842 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.187169 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f354-23d6-45ed-ba47-84237784f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.187440 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f354-23d6-45ed-ba47-84237784f842 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.188379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1f354-23d6-45ed-ba47-84237784f842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.190605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1f354-23d6-45ed-ba47-84237784f842 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.221664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1261/2530] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:52:31 2022] POST /identity/v3/users => generated 309 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:52:31.228643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c26b2-6f1e-4f0f-bc83-5e1c51e0802e admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.241566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c26b2-6f1e-4f0f-bc83-5e1c51e0802e admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.246523 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5a43-0a93-4a86-a3cd-d03649b7482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.247217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5a43-0a93-4a86-a3cd-d03649b7482e admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.248371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5a43-0a93-4a86-a3cd-d03649b7482e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.248650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5a43-0a93-4a86-a3cd-d03649b7482e admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.249300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5a43-0a93-4a86-a3cd-d03649b7482e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.251162 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5a43-0a93-4a86-a3cd-d03649b7482e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.264799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1270/2531] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:31.272039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1f354-23d6-45ed-ba47-84237784f842 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.283268 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1f354-23d6-45ed-ba47-84237784f842 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.288292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c928423-d512-4f7f-96d7-d9adf9478344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.289016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c928423-d512-4f7f-96d7-d9adf9478344 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.289362 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c928423-d512-4f7f-96d7-d9adf9478344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.289698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c928423-d512-4f7f-96d7-d9adf9478344 admin admin] PATH_INFO: `/v3/projects/bddcf4761a1b4717802a636e15d63d95/users/7431aed8ecf34b35b1c016c3cde9e190/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.308017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c928423-d512-4f7f-96d7-d9adf9478344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddcf4761a1b4717802a636e15d63d95, user_id=7431aed8ecf34b35b1c016c3cde9e190, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.312324 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c928423-d512-4f7f-96d7-d9adf9478344 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.325428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1262/2532] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:31 2022] PUT /identity/v3/projects/bddcf4761a1b4717802a636e15d63d95/users/7431aed8ecf34b35b1c016c3cde9e190/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:31.329765 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5a43-0a93-4a86-a3cd-d03649b7482e admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.342184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5a43-0a93-4a86-a3cd-d03649b7482e admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.402422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0971bdf-9d76-4871-812f-c169d7fc53a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.403092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0971bdf-9d76-4871-812f-c169d7fc53a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.403373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0971bdf-9d76-4871-812f-c169d7fc53a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.403674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0971bdf-9d76-4871-812f-c169d7fc53a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.404337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0971bdf-9d76-4871-812f-c169d7fc53a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.406173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0971bdf-9d76-4871-812f-c169d7fc53a8 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.417062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1271/2533] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:31.422022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c928423-d512-4f7f-96d7-d9adf9478344 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.432833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c928423-d512-4f7f-96d7-d9adf9478344 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.438635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097307c-3fe2-44c0-9672-ab3c31e4677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.439335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097307c-3fe2-44c0-9672-ab3c31e4677a admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.439615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097307c-3fe2-44c0-9672-ab3c31e4677a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.439889 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097307c-3fe2-44c0-9672-ab3c31e4677a admin admin] PATH_INFO: `/v3/projects/bddcf4761a1b4717802a636e15d63d95/users/7431aed8ecf34b35b1c016c3cde9e190/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.441851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097307c-3fe2-44c0-9672-ab3c31e4677a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddcf4761a1b4717802a636e15d63d95, user_id=7431aed8ecf34b35b1c016c3cde9e190, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.444531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097307c-3fe2-44c0-9672-ab3c31e4677a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.455710 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1263/2534] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:31 2022] PUT /identity/v3/projects/bddcf4761a1b4717802a636e15d63d95/users/7431aed8ecf34b35b1c016c3cde9e190/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:32.173130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049326a5-fcdc-41b2-ad4d-7bbcc792dea3 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.173730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049326a5-fcdc-41b2-ad4d-7bbcc792dea3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.173730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049326a5-fcdc-41b2-ad4d-7bbcc792dea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.204669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-049326a5-fcdc-41b2-ad4d-7bbcc792dea3 None None] MFA Rules not processed for user `7431aed8ecf34b35b1c016c3cde9e190`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:32.205920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-049326a5-fcdc-41b2-ad4d-7bbcc792dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:32.233205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.285674 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1272/2535] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:33.011727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097307c-3fe2-44c0-9672-ab3c31e4677a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.088445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097307c-3fe2-44c0-9672-ab3c31e4677a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.093687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c765e9-c82a-4d49-ac14-d5e8b38c67c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.094429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c765e9-c82a-4d49-ac14-d5e8b38c67c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.095397 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c765e9-c82a-4d49-ac14-d5e8b38c67c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.095681 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c765e9-c82a-4d49-ac14-d5e8b38c67c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.098145 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-11c765e9-c82a-4d49-ac14-d5e8b38c67c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:33.183189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c765e9-c82a-4d49-ac14-d5e8b38c67c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.185016 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c765e9-c82a-4d49-ac14-d5e8b38c67c9 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.197447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1264/2536] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:33.374870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049326a5-fcdc-41b2-ad4d-7bbcc792dea3 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.446039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049326a5-fcdc-41b2-ad4d-7bbcc792dea3 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.451581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.452321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.452625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.452898 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] PATH_INFO: `/v3/users/4764248dc1a14c608157d601a23ba6ff` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.454066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4764248dc1a14c608157d601a23ba6ff)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.456032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.510678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4764248dc1a14c608157d601a23ba6ff'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.511462 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4764248dc1a14c608157d601a23ba6ff'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.524482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4764248dc1a14c608157d601a23ba6ff'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.533014 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4764248dc1a14c608157d601a23ba6ff'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.533662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4764248dc1a14c608157d601a23ba6ff'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.546736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1273/2537] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:52:33 2022] DELETE /identity/v3/users/4764248dc1a14c608157d601a23ba6ff => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:33.745994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c765e9-c82a-4d49-ac14-d5e8b38c67c9 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.760639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c765e9-c82a-4d49-ac14-d5e8b38c67c9 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.767166 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:33.832561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.833188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.833469 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.833743 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] PATH_INFO: `/v3/projects/b5d170987dfd4ae58f6c73f6f66f6a53` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.834916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d170987dfd4ae58f6c73f6f66f6a53)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.837074 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.897537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d170987dfd4ae58f6c73f6f66f6a53', 'request_id': 'req-d0959ca8-a11a-45f3-850e-9867ed0f096f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.905870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d170987dfd4ae58f6c73f6f66f6a53', 'request_id': 'req-d0959ca8-a11a-45f3-850e-9867ed0f096f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.915358 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d170987dfd4ae58f6c73f6f66f6a53', 'request_id': 'req-d0959ca8-a11a-45f3-850e-9867ed0f096f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.928110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] The token cache is being invalidate because project b5d170987dfd4ae58f6c73f6f66f6a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:52:33.928399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.929218 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:33.930735 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1265/2538] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:52:33 2022] DELETE /identity/v3/projects/b5d170987dfd4ae58f6c73f6f66f6a53 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:33.934951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.936852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:33.952275 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81c152-fa15-4675-8aec-24da77d3e5c4 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.998622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:34.018347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.019032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.019316 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.019609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] PATH_INFO: `/v3/users/7431aed8ecf34b35b1c016c3cde9e190` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.021380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7431aed8ecf34b35b1c016c3cde9e190)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:34.022727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:34.078892 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7431aed8ecf34b35b1c016c3cde9e190'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.079578 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7431aed8ecf34b35b1c016c3cde9e190'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.093878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7431aed8ecf34b35b1c016c3cde9e190'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.106662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7431aed8ecf34b35b1c016c3cde9e190'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.108474 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7431aed8ecf34b35b1c016c3cde9e190'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.122139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1274/2539] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:52:33 2022] DELETE /identity/v3/users/7431aed8ecf34b35b1c016c3cde9e190 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:34.302650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.304251 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:34.333354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0959ca8-a11a-45f3-850e-9867ed0f096f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.401987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.402625 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.402966 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.403237 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] PATH_INFO: `/v3/projects/bddcf4761a1b4717802a636e15d63d95` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.405057 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bddcf4761a1b4717802a636e15d63d95)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:34.407038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:34.443211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.445014 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:34.459674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:34.468346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bddcf4761a1b4717802a636e15d63d95', 'request_id': 'req-e5c2a719-d8b3-47bb-a8ce-f546dab69364'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.475567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bddcf4761a1b4717802a636e15d63d95', 'request_id': 'req-e5c2a719-d8b3-47bb-a8ce-f546dab69364'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.488198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bddcf4761a1b4717802a636e15d63d95', 'request_id': 'req-e5c2a719-d8b3-47bb-a8ce-f546dab69364'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.502219 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] The token cache is being invalidate because project bddcf4761a1b4717802a636e15d63d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:52:34.502508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.503188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e5c2a719-d8b3-47bb-a8ce-f546dab69364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:34.505086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1266/2540] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:52:34 2022] DELETE /identity/v3/projects/bddcf4761a1b4717802a636e15d63d95 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:34.509811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e6c2-db30-4273-970c-c84edd922814 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.510104 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e6c2-db30-4273-970c-c84edd922814 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.510386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e6c2-db30-4273-970c-c84edd922814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.517269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dab38-7658-42cd-81f0-2caa6940843d admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.537496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8c04e6c2-db30-4273-970c-c84edd922814 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:34.538805 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8c04e6c2-db30-4273-970c-c84edd922814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:34.587273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04626fad-29d9-4917-aef8-57c8cde2f220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.587893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04626fad-29d9-4917-aef8-57c8cde2f220 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.588205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04626fad-29d9-4917-aef8-57c8cde2f220 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.588442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04626fad-29d9-4917-aef8-57c8cde2f220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.591985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-04626fad-29d9-4917-aef8-57c8cde2f220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:34.636550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1267/2541] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:34.648141 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d2ad-ba86-4cb9-9475-bd14e4826d21 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.648686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d2ad-ba86-4cb9-9475-bd14e4826d21 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.649174 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d2ad-ba86-4cb9-9475-bd14e4826d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.652862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:34.683707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-17e8d2ad-ba86-4cb9-9475-bd14e4826d21 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:34.686193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-17e8d2ad-ba86-4cb9-9475-bd14e4826d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:34.703325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1268/2542] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:34.708374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8d2ad-ba86-4cb9-9475-bd14e4826d21 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.723290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8d2ad-ba86-4cb9-9475-bd14e4826d21 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.731809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b68a-a3a8-4837-8818-90bb4cbb9c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.732787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b68a-a3a8-4837-8818-90bb4cbb9c1f admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.734481 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b68a-a3a8-4837-8818-90bb4cbb9c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.734940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b68a-a3a8-4837-8818-90bb4cbb9c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.735934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b68a-a3a8-4837-8818-90bb4cbb9c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:34.736370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b68a-a3a8-4837-8818-90bb4cbb9c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:34.738797 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04626fad-29d9-4917-aef8-57c8cde2f220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:34.739551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b68a-a3a8-4837-8818-90bb4cbb9c1f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:34.740846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04626fad-29d9-4917-aef8-57c8cde2f220 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:34.755619 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1275/2543] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:52:34.767106 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1269/2544] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:34.771889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04626fad-29d9-4917-aef8-57c8cde2f220 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.786128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04626fad-29d9-4917-aef8-57c8cde2f220 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.797497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950abe0-6dee-487f-84e4-8997bc858ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.798133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950abe0-6dee-487f-84e4-8997bc858ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.798413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950abe0-6dee-487f-84e4-8997bc858ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.798686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950abe0-6dee-487f-84e4-8997bc858ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.799450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950abe0-6dee-487f-84e4-8997bc858ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:34.801572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950abe0-6dee-487f-84e4-8997bc858ea7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:34.853822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1276/2545] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:52:34 2022] POST /identity/v3/projects => generated 361 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:34.859783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b68a-a3a8-4837-8818-90bb4cbb9c1f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.876904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b68a-a3a8-4837-8818-90bb4cbb9c1f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.969911 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48138db-24aa-4ec3-a609-7aa135b7e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.971655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48138db-24aa-4ec3-a609-7aa135b7e86d admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.972298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48138db-24aa-4ec3-a609-7aa135b7e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.972995 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48138db-24aa-4ec3-a609-7aa135b7e86d admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.974006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48138db-24aa-4ec3-a609-7aa135b7e86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:34.977615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48138db-24aa-4ec3-a609-7aa135b7e86d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.016950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1270/2546] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:52:34 2022] POST /identity/v3/users => generated 281 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:35.018586 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950abe0-6dee-487f-84e4-8997bc858ea7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.030849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950abe0-6dee-487f-84e4-8997bc858ea7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.035737 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db3cdb-45d7-4105-ab18-50649c7533c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.036343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3cdb-45d7-4105-ab18-50649c7533c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.036638 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3cdb-45d7-4105-ab18-50649c7533c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.036912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3cdb-45d7-4105-ab18-50649c7533c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.037563 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db3cdb-45d7-4105-ab18-50649c7533c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.039231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db3cdb-45d7-4105-ab18-50649c7533c4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.051387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1277/2547] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:35.056749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48138db-24aa-4ec3-a609-7aa135b7e86d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.071894 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48138db-24aa-4ec3-a609-7aa135b7e86d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.080448 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3f8ff-dd8b-427c-a6d3-81fde05daffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.081317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f8ff-dd8b-427c-a6d3-81fde05daffa admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.081981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f8ff-dd8b-427c-a6d3-81fde05daffa admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.082125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f8ff-dd8b-427c-a6d3-81fde05daffa admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.083102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3f8ff-dd8b-427c-a6d3-81fde05daffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.085607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3f8ff-dd8b-427c-a6d3-81fde05daffa admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.099322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1271/2548] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:35.103621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db3cdb-45d7-4105-ab18-50649c7533c4 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.115144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db3cdb-45d7-4105-ab18-50649c7533c4 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.120447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b5c7-0e0b-4e4c-81b5-695e07f6149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.121412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b5c7-0e0b-4e4c-81b5-695e07f6149b admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.121611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b5c7-0e0b-4e4c-81b5-695e07f6149b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.121984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b5c7-0e0b-4e4c-81b5-695e07f6149b admin admin] PATH_INFO: `/v3/projects/82aad872baae4bf48186ce94f055b524/users/360ec2082a96488e99f766467704f99f/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.141621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b5c7-0e0b-4e4c-81b5-695e07f6149b admin admin] RBAC: Authorizing `identity:create_grant(project_id=82aad872baae4bf48186ce94f055b524, user_id=360ec2082a96488e99f766467704f99f, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.145069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b5c7-0e0b-4e4c-81b5-695e07f6149b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.166700 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1278/2549] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:35 2022] PUT /identity/v3/projects/82aad872baae4bf48186ce94f055b524/users/360ec2082a96488e99f766467704f99f/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:35.175952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029722-e844-4de6-97f9-4870d9c4c31e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.176377 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029722-e844-4de6-97f9-4870d9c4c31e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.176728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029722-e844-4de6-97f9-4870d9c4c31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.211785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-66029722-e844-4de6-97f9-4870d9c4c31e None None] MFA Rules not processed for user `360ec2082a96488e99f766467704f99f`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:35.213043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-66029722-e844-4de6-97f9-4870d9c4c31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:35.233876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:35.300225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1272/2550] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:35.304550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b5c7-0e0b-4e4c-81b5-695e07f6149b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.385725 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b5c7-0e0b-4e4c-81b5-695e07f6149b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.394589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb655328-fcf6-4e8d-86ac-6ba203233bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.395261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb655328-fcf6-4e8d-86ac-6ba203233bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.395542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb655328-fcf6-4e8d-86ac-6ba203233bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.395813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb655328-fcf6-4e8d-86ac-6ba203233bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.396447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb655328-fcf6-4e8d-86ac-6ba203233bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.398372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb655328-fcf6-4e8d-86ac-6ba203233bf7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.438205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1279/2551] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:52:35 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:35.442873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66029722-e844-4de6-97f9-4870d9c4c31e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.456307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66029722-e844-4de6-97f9-4870d9c4c31e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.527322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef508c-7640-482a-a7cf-7f47f81f87a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.528064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef508c-7640-482a-a7cf-7f47f81f87a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.528356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef508c-7640-482a-a7cf-7f47f81f87a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.529080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef508c-7640-482a-a7cf-7f47f81f87a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.529728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef508c-7640-482a-a7cf-7f47f81f87a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.531723 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef508c-7640-482a-a7cf-7f47f81f87a4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.554623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1273/2552] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:52:35 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:35.558687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb655328-fcf6-4e8d-86ac-6ba203233bf7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.570222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb655328-fcf6-4e8d-86ac-6ba203233bf7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.575104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5b3d-0b27-4358-a600-5edcd942310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.576344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5b3d-0b27-4358-a600-5edcd942310f admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.576622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5b3d-0b27-4358-a600-5edcd942310f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.576902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5b3d-0b27-4358-a600-5edcd942310f admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.577553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5b3d-0b27-4358-a600-5edcd942310f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.579200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5b3d-0b27-4358-a600-5edcd942310f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.595063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1280/2553] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:35.595877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef508c-7640-482a-a7cf-7f47f81f87a4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.606698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef508c-7640-482a-a7cf-7f47f81f87a4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.611980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a217c3-862f-4154-a1a4-c09098fa9e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.612667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a217c3-862f-4154-a1a4-c09098fa9e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.612931 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a217c3-862f-4154-a1a4-c09098fa9e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.613208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a217c3-862f-4154-a1a4-c09098fa9e4e admin admin] PATH_INFO: `/v3/projects/79bb272eb5c04eaf9134ff7a7d6274e1/users/573e4fdf4b8c4abf85b84b433369191b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.630508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a217c3-862f-4154-a1a4-c09098fa9e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bb272eb5c04eaf9134ff7a7d6274e1, user_id=573e4fdf4b8c4abf85b84b433369191b, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.633491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a217c3-862f-4154-a1a4-c09098fa9e4e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.649310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1274/2554] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:35 2022] PUT /identity/v3/projects/79bb272eb5c04eaf9134ff7a7d6274e1/users/573e4fdf4b8c4abf85b84b433369191b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:35.653450 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5b3d-0b27-4358-a600-5edcd942310f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.664205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5b3d-0b27-4358-a600-5edcd942310f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.711910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:35.745888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6ba1-c25e-484c-a0e1-9880c5af1388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.746580 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6ba1-c25e-484c-a0e1-9880c5af1388 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.746892 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6ba1-c25e-484c-a0e1-9880c5af1388 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.747247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6ba1-c25e-484c-a0e1-9880c5af1388 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.748735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d6ba1-c25e-484c-a0e1-9880c5af1388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.750338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d6ba1-c25e-484c-a0e1-9880c5af1388 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.764188 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1281/2555] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:35.768439 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a217c3-862f-4154-a1a4-c09098fa9e4e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.780392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a217c3-862f-4154-a1a4-c09098fa9e4e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.788212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a798-7367-40ce-b2d1-5cf6beda54f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.789256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a798-7367-40ce-b2d1-5cf6beda54f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.789621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a798-7367-40ce-b2d1-5cf6beda54f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.789896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a798-7367-40ce-b2d1-5cf6beda54f4 admin admin] PATH_INFO: `/v3/projects/79bb272eb5c04eaf9134ff7a7d6274e1/users/573e4fdf4b8c4abf85b84b433369191b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.792867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847a798-7367-40ce-b2d1-5cf6beda54f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bb272eb5c04eaf9134ff7a7d6274e1, user_id=573e4fdf4b8c4abf85b84b433369191b, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.798133 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847a798-7367-40ce-b2d1-5cf6beda54f4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.809425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1275/2556] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:35 2022] PUT /identity/v3/projects/79bb272eb5c04eaf9134ff7a7d6274e1/users/573e4fdf4b8c4abf85b84b433369191b/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:35.821676 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453269-0dd6-477e-8870-3222fda7bd4e None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.821989 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453269-0dd6-477e-8870-3222fda7bd4e None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.822270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453269-0dd6-477e-8870-3222fda7bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.855981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e5453269-0dd6-477e-8870-3222fda7bd4e None None] MFA Rules not processed for user `573e4fdf4b8c4abf85b84b433369191b`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:35.857938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e5453269-0dd6-477e-8870-3222fda7bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:35.952269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1282/2557] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:35.963596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a798-7367-40ce-b2d1-5cf6beda54f4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.965315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9847a798-7367-40ce-b2d1-5cf6beda54f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:36.041733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a798-7367-40ce-b2d1-5cf6beda54f4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.047453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a1513-d980-474c-a15c-6d9ca7692f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.048242 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a1513-d980-474c-a15c-6d9ca7692f41 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.048578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a1513-d980-474c-a15c-6d9ca7692f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.048812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a1513-d980-474c-a15c-6d9ca7692f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.058668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a1513-d980-474c-a15c-6d9ca7692f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.060557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a1513-d980-474c-a15c-6d9ca7692f41 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.071481 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1276/2558] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:36.517246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5453269-0dd6-477e-8870-3222fda7bd4e None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.580554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5453269-0dd6-477e-8870-3222fda7bd4e None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.585168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.585806 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.586083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.586356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] PATH_INFO: `/v3/users/360ec2082a96488e99f766467704f99f` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.587624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=360ec2082a96488e99f766467704f99f)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.589597 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.638719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360ec2082a96488e99f766467704f99f'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:36.639402 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360ec2082a96488e99f766467704f99f'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:36.648483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.654415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360ec2082a96488e99f766467704f99f'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:36.662840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360ec2082a96488e99f766467704f99f'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:36.663468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360ec2082a96488e99f766467704f99f'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:36.676244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1283/2559] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:52:36 2022] DELETE /identity/v3/users/360ec2082a96488e99f766467704f99f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:36.681793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a80ac-214b-4e70-a27b-dad7fa4c51f7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.682296 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a80ac-214b-4e70-a27b-dad7fa4c51f7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.682402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a80ac-214b-4e70-a27b-dad7fa4c51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.701629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-db0a80ac-214b-4e70-a27b-dad7fa4c51f7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:36.702852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-db0a80ac-214b-4e70-a27b-dad7fa4c51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:36.711259 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.764548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1277/2560] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:36.774410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.775907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:36.847239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7fb4f-c895-4965-bee2-d2c254815596 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.851201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a232a-8fef-4cde-bae6-b5f2add7d8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.851864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a232a-8fef-4cde-bae6-b5f2add7d8fa service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.852138 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a232a-8fef-4cde-bae6-b5f2add7d8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.852454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a232a-8fef-4cde-bae6-b5f2add7d8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.863679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a232a-8fef-4cde-bae6-b5f2add7d8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.865329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a232a-8fef-4cde-bae6-b5f2add7d8fa service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.876654 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1284/2561] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:37.181562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a80ac-214b-4e70-a27b-dad7fa4c51f7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.181562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-db0a80ac-214b-4e70-a27b-dad7fa4c51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:37.200066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a80ac-214b-4e70-a27b-dad7fa4c51f7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.204921 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.205577 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.205914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.206333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] PATH_INFO: `/v3/projects/82aad872baae4bf48186ce94f055b524` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.207575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82aad872baae4bf48186ce94f055b524)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.209511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.261510 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82aad872baae4bf48186ce94f055b524', 'request_id': 'req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.268357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82aad872baae4bf48186ce94f055b524', 'request_id': 'req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.276944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82aad872baae4bf48186ce94f055b524', 'request_id': 'req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.288857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] The token cache is being invalidate because project 82aad872baae4bf48186ce94f055b524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:52:37.289371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.290086 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.291606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1278/2562] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:52:37 2022] DELETE /identity/v3/projects/82aad872baae4bf48186ce94f055b524 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:37.296274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a232a-8fef-4cde-bae6-b5f2add7d8fa service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.305967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a232a-8fef-4cde-bae6-b5f2add7d8fa service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.370441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.371128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.371477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.371764 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] PATH_INFO: `/v3/users/573e4fdf4b8c4abf85b84b433369191b` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.373907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] RBAC: Authorizing `identity:delete_user(user_id=573e4fdf4b8c4abf85b84b433369191b)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.375906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.425366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573e4fdf4b8c4abf85b84b433369191b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.426042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573e4fdf4b8c4abf85b84b433369191b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.440822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573e4fdf4b8c4abf85b84b433369191b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.449952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573e4fdf4b8c4abf85b84b433369191b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.450741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-c44cc522-c63a-47d1-9862-1e125625fabd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573e4fdf4b8c4abf85b84b433369191b'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.459704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.472213 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1285/2563] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:52:37 2022] DELETE /identity/v3/users/573e4fdf4b8c4abf85b84b433369191b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:37.757846 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.759602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:37.792709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4c1d-b8a7-4349-83e9-79fe36c2cd5c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.852489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.853165 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.853445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.853718 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] PATH_INFO: `/v3/projects/79bb272eb5c04eaf9134ff7a7d6274e1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.854858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79bb272eb5c04eaf9134ff7a7d6274e1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.857516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.899860 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.909948 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79bb272eb5c04eaf9134ff7a7d6274e1', 'request_id': 'req-b387e9a5-0fab-462d-8d5b-f37865b208f8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.916646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79bb272eb5c04eaf9134ff7a7d6274e1', 'request_id': 'req-b387e9a5-0fab-462d-8d5b-f37865b208f8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.926482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79bb272eb5c04eaf9134ff7a7d6274e1', 'request_id': 'req-b387e9a5-0fab-462d-8d5b-f37865b208f8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.937756 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] The token cache is being invalidate because project 79bb272eb5c04eaf9134ff7a7d6274e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:52:37.938044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.938685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b387e9a5-0fab-462d-8d5b-f37865b208f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:37.940346 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1279/2564] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:52:37 2022] DELETE /identity/v3/projects/79bb272eb5c04eaf9134ff7a7d6274e1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:37.945118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2cae4-1f91-4fb6-81a0-f79a854d569d None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.949356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2cae4-1f91-4fb6-81a0-f79a854d569d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.949356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2cae4-1f91-4fb6-81a0-f79a854d569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.972106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c8e2cae4-1f91-4fb6-81a0-f79a854d569d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:37.973338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c8e2cae4-1f91-4fb6-81a0-f79a854d569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:38.041271 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1286/2565] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:38.050022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ea180-e996-4ab0-8dc7-04d25e2e5ce6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.050319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ea180-e996-4ab0-8dc7-04d25e2e5ce6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.050589 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ea180-e996-4ab0-8dc7-04d25e2e5ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.071914 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-735ea180-e996-4ab0-8dc7-04d25e2e5ce6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:38.073154 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-735ea180-e996-4ab0-8dc7-04d25e2e5ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:38.082159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1280/2566] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:38.087501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2cae4-1f91-4fb6-81a0-f79a854d569d None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.102609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2cae4-1f91-4fb6-81a0-f79a854d569d None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.108611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ffc1-5c24-4828-a6e2-8d8faae2f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.109231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ffc1-5c24-4828-a6e2-8d8faae2f281 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.109513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ffc1-5c24-4828-a6e2-8d8faae2f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.109786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ffc1-5c24-4828-a6e2-8d8faae2f281 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.110440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309ffc1-5c24-4828-a6e2-8d8faae2f281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:38.110749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309ffc1-5c24-4828-a6e2-8d8faae2f281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.112385 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309ffc1-5c24-4828-a6e2-8d8faae2f281 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.124822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1287/2567] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:38.129276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ea180-e996-4ab0-8dc7-04d25e2e5ce6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.139423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ea180-e996-4ab0-8dc7-04d25e2e5ce6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.144497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd462b-5954-4f52-962d-3ef40d8a222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.145087 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd462b-5954-4f52-962d-3ef40d8a222b admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.145360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd462b-5954-4f52-962d-3ef40d8a222b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.145624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd462b-5954-4f52-962d-3ef40d8a222b admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.146298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd462b-5954-4f52-962d-3ef40d8a222b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.148179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd462b-5954-4f52-962d-3ef40d8a222b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.176183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1281/2568] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:52:38 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:38.180849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ffc1-5c24-4828-a6e2-8d8faae2f281 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.190728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ffc1-5c24-4828-a6e2-8d8faae2f281 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.247289 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2efe8e-c03c-4769-9ed2-92c9f64a8dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.247891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2efe8e-c03c-4769-9ed2-92c9f64a8dad admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.248163 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2efe8e-c03c-4769-9ed2-92c9f64a8dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.248434 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2efe8e-c03c-4769-9ed2-92c9f64a8dad admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.249058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2efe8e-c03c-4769-9ed2-92c9f64a8dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.251026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2efe8e-c03c-4769-9ed2-92c9f64a8dad admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.272875 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1288/2569] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:52:38 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:38.277032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd462b-5954-4f52-962d-3ef40d8a222b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.288941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd462b-5954-4f52-962d-3ef40d8a222b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.293682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0ee3f-eee9-4e91-a621-e0ed9d8b6afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.295008 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0ee3f-eee9-4e91-a621-e0ed9d8b6afa admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.295298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0ee3f-eee9-4e91-a621-e0ed9d8b6afa admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.295576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0ee3f-eee9-4e91-a621-e0ed9d8b6afa admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.296238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0ee3f-eee9-4e91-a621-e0ed9d8b6afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.297841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0ee3f-eee9-4e91-a621-e0ed9d8b6afa admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.308323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1282/2570] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:38.313009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2efe8e-c03c-4769-9ed2-92c9f64a8dad admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.322984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2efe8e-c03c-4769-9ed2-92c9f64a8dad admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.328482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051999e-0693-4b72-8144-1d90b61a90ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.329082 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051999e-0693-4b72-8144-1d90b61a90ac admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.329357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051999e-0693-4b72-8144-1d90b61a90ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.329643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051999e-0693-4b72-8144-1d90b61a90ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.330268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051999e-0693-4b72-8144-1d90b61a90ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.331876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051999e-0693-4b72-8144-1d90b61a90ac admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.346844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1289/2571] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:38.348099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0ee3f-eee9-4e91-a621-e0ed9d8b6afa admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.358564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0ee3f-eee9-4e91-a621-e0ed9d8b6afa admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.363652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8b61f-4271-4555-b038-de572fb0edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.364311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8b61f-4271-4555-b038-de572fb0edbe admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.364585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8b61f-4271-4555-b038-de572fb0edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.364856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8b61f-4271-4555-b038-de572fb0edbe admin admin] PATH_INFO: `/v3/projects/0d618cd8d23c496fa53ad83de7702a48/users/63f3c9c0d8674253877cdc8bd168c763/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.381195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8b61f-4271-4555-b038-de572fb0edbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d618cd8d23c496fa53ad83de7702a48, user_id=63f3c9c0d8674253877cdc8bd168c763, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.384130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8b61f-4271-4555-b038-de572fb0edbe admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.397816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1283/2572] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:38 2022] PUT /identity/v3/projects/0d618cd8d23c496fa53ad83de7702a48/users/63f3c9c0d8674253877cdc8bd168c763/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:38.408131 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2b0bf-f1e8-4304-b1db-4fad9aaf1459 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.408413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2b0bf-f1e8-4304-b1db-4fad9aaf1459 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.408689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2b0bf-f1e8-4304-b1db-4fad9aaf1459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.437912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-39f2b0bf-f1e8-4304-b1db-4fad9aaf1459 None None] MFA Rules not processed for user `63f3c9c0d8674253877cdc8bd168c763`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:38.439159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-39f2b0bf-f1e8-4304-b1db-4fad9aaf1459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:38.500468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.515062 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1290/2573] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:38.520341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8b61f-4271-4555-b038-de572fb0edbe admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.586555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8b61f-4271-4555-b038-de572fb0edbe admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.599383 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe841-7a38-4500-b571-e91cfdc82873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.600018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe841-7a38-4500-b571-e91cfdc82873 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.600295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe841-7a38-4500-b571-e91cfdc82873 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.600568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe841-7a38-4500-b571-e91cfdc82873 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.601200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe841-7a38-4500-b571-e91cfdc82873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.603210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe841-7a38-4500-b571-e91cfdc82873 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.632834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1284/2574] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:52:38 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:38.636930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2b0bf-f1e8-4304-b1db-4fad9aaf1459 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.649019 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2b0bf-f1e8-4304-b1db-4fad9aaf1459 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.706177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae750902-1e42-46f6-81b2-1dedd3b04aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.706684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae750902-1e42-46f6-81b2-1dedd3b04aeb admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.706993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae750902-1e42-46f6-81b2-1dedd3b04aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.707267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae750902-1e42-46f6-81b2-1dedd3b04aeb admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.707882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae750902-1e42-46f6-81b2-1dedd3b04aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.709794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae750902-1e42-46f6-81b2-1dedd3b04aeb admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.730743 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1291/2575] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:52:38 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:38.735305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe841-7a38-4500-b571-e91cfdc82873 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.745553 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe841-7a38-4500-b571-e91cfdc82873 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.750842 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d62d0-f112-4586-b34f-7b01d4e1affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.751445 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d62d0-f112-4586-b34f-7b01d4e1affc admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.751845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d62d0-f112-4586-b34f-7b01d4e1affc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.752119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d62d0-f112-4586-b34f-7b01d4e1affc admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.752757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d62d0-f112-4586-b34f-7b01d4e1affc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.754341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d62d0-f112-4586-b34f-7b01d4e1affc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.765560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1285/2576] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:38.769682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae750902-1e42-46f6-81b2-1dedd3b04aeb admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.779908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae750902-1e42-46f6-81b2-1dedd3b04aeb admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.784770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea048877-991f-409f-a6a7-18c3dbae51ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.785446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea048877-991f-409f-a6a7-18c3dbae51ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.785717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea048877-991f-409f-a6a7-18c3dbae51ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.785995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea048877-991f-409f-a6a7-18c3dbae51ab admin admin] PATH_INFO: `/v3/projects/32d508596d9f4bbb9d8b56cd39f22f33/users/01d01d360f5c402088dc1da4fb8debd0/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.801747 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea048877-991f-409f-a6a7-18c3dbae51ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d508596d9f4bbb9d8b56cd39f22f33, user_id=01d01d360f5c402088dc1da4fb8debd0, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.804447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea048877-991f-409f-a6a7-18c3dbae51ab admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.818100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1292/2577] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:38 2022] PUT /identity/v3/projects/32d508596d9f4bbb9d8b56cd39f22f33/users/01d01d360f5c402088dc1da4fb8debd0/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:38.822430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d62d0-f112-4586-b34f-7b01d4e1affc admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.832573 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d62d0-f112-4586-b34f-7b01d4e1affc admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.870236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.897109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb25ea-1573-49a6-8c81-6b5f2ff3893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.897722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb25ea-1573-49a6-8c81-6b5f2ff3893c admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.898004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb25ea-1573-49a6-8c81-6b5f2ff3893c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.898280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb25ea-1573-49a6-8c81-6b5f2ff3893c admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.898962 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb25ea-1573-49a6-8c81-6b5f2ff3893c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.900560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb25ea-1573-49a6-8c81-6b5f2ff3893c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.910505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1286/2578] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:38.914862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea048877-991f-409f-a6a7-18c3dbae51ab admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.926168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea048877-991f-409f-a6a7-18c3dbae51ab admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.931333 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31bf02-07ff-40f2-9d40-e36dc20395f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.931992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31bf02-07ff-40f2-9d40-e36dc20395f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.932273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31bf02-07ff-40f2-9d40-e36dc20395f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.932550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31bf02-07ff-40f2-9d40-e36dc20395f0 admin admin] PATH_INFO: `/v3/projects/32d508596d9f4bbb9d8b56cd39f22f33/users/01d01d360f5c402088dc1da4fb8debd0/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.934554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31bf02-07ff-40f2-9d40-e36dc20395f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d508596d9f4bbb9d8b56cd39f22f33, user_id=01d01d360f5c402088dc1da4fb8debd0, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.938034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31bf02-07ff-40f2-9d40-e36dc20395f0 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.948720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1293/2579] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:38 2022] PUT /identity/v3/projects/32d508596d9f4bbb9d8b56cd39f22f33/users/01d01d360f5c402088dc1da4fb8debd0/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:38.960337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78021b3-a3a4-4efe-89c8-b86a8957c25c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.960552 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78021b3-a3a4-4efe-89c8-b86a8957c25c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.960822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78021b3-a3a4-4efe-89c8-b86a8957c25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.997043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b78021b3-a3a4-4efe-89c8-b86a8957c25c None None] MFA Rules not processed for user `01d01d360f5c402088dc1da4fb8debd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:38.999130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b78021b3-a3a4-4efe-89c8-b86a8957c25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:39.069701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1287/2580] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:39.081744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31bf02-07ff-40f2-9d40-e36dc20395f0 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.083650 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-5b31bf02-07ff-40f2-9d40-e36dc20395f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:39.145229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31bf02-07ff-40f2-9d40-e36dc20395f0 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.149044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62fb1-e867-43b4-9e85-1da4ebb96c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.149651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62fb1-e867-43b4-9e85-1da4ebb96c62 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.149932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62fb1-e867-43b4-9e85-1da4ebb96c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.150210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62fb1-e867-43b4-9e85-1da4ebb96c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.207814 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62fb1-e867-43b4-9e85-1da4ebb96c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.209243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62fb1-e867-43b4-9e85-1da4ebb96c62 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.213839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.220493 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1294/2581] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:40.587936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78021b3-a3a4-4efe-89c8-b86a8957c25c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.595111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b78021b3-a3a4-4efe-89c8-b86a8957c25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:40.608565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78021b3-a3a4-4efe-89c8-b86a8957c25c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.612306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caeb77b-3daa-4f40-82b2-c9fe22757a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.612936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeb77b-3daa-4f40-82b2-c9fe22757a44 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.613213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeb77b-3daa-4f40-82b2-c9fe22757a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.613487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeb77b-3daa-4f40-82b2-c9fe22757a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.623947 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caeb77b-3daa-4f40-82b2-c9fe22757a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.625414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caeb77b-3daa-4f40-82b2-c9fe22757a44 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.638494 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1288/2582] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:44.440492 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62fb1-e867-43b4-9e85-1da4ebb96c62 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:44.506816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62fb1-e867-43b4-9e85-1da4ebb96c62 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:44.511415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:44.512052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.512327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.512597 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] PATH_INFO: `/v3/users/63f3c9c0d8674253877cdc8bd168c763` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.513711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f3c9c0d8674253877cdc8bd168c763)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:44.515880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:44.566226 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f3c9c0d8674253877cdc8bd168c763'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:44.566902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f3c9c0d8674253877cdc8bd168c763'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:44.581000 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f3c9c0d8674253877cdc8bd168c763'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:44.588351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f3c9c0d8674253877cdc8bd168c763'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:44.589378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f3c9c0d8674253877cdc8bd168c763'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:44.603883 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1295/2583] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:52:44 2022] DELETE /identity/v3/users/63f3c9c0d8674253877cdc8bd168c763 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:44.608398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027cc30-4dae-4596-b06a-82b654eb0988 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.609356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027cc30-4dae-4596-b06a-82b654eb0988 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.609583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027cc30-4dae-4596-b06a-82b654eb0988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.628543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c027cc30-4dae-4596-b06a-82b654eb0988 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:44.629739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c027cc30-4dae-4596-b06a-82b654eb0988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:44.690849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1289/2584] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:44.701051 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:44.703905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:44.768577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951fe2-2b42-47c2-a7cc-a08f91939062 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:44.772782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe712-e168-4379-8735-66f50b0694b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:44.773463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe712-e168-4379-8735-66f50b0694b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.773748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe712-e168-4379-8735-66f50b0694b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.774025 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe712-e168-4379-8735-66f50b0694b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.787727 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebe712-e168-4379-8735-66f50b0694b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:44.789511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebe712-e168-4379-8735-66f50b0694b2 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:44.801812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1296/2585] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:45.513202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027cc30-4dae-4596-b06a-82b654eb0988 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.515288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c027cc30-4dae-4596-b06a-82b654eb0988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:45.527627 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027cc30-4dae-4596-b06a-82b654eb0988 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.533011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.533639 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.533916 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.534188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] PATH_INFO: `/v3/projects/0d618cd8d23c496fa53ad83de7702a48` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.535347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d618cd8d23c496fa53ad83de7702a48)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.537291 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.596020 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.597518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d618cd8d23c496fa53ad83de7702a48', 'request_id': 'req-c3fa75b8-1f90-4c73-99ec-d32712b49e86'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.607223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d618cd8d23c496fa53ad83de7702a48', 'request_id': 'req-c3fa75b8-1f90-4c73-99ec-d32712b49e86'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.615299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d618cd8d23c496fa53ad83de7702a48', 'request_id': 'req-c3fa75b8-1f90-4c73-99ec-d32712b49e86'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.626546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] The token cache is being invalidate because project 0d618cd8d23c496fa53ad83de7702a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:52:45.626879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.627555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.629055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1290/2586] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:52:45 2022] DELETE /identity/v3/projects/0d618cd8d23c496fa53ad83de7702a48 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:45.633358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe712-e168-4379-8735-66f50b0694b2 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.644026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe712-e168-4379-8735-66f50b0694b2 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.664782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.708041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.708675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.708950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.709220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] PATH_INFO: `/v3/users/01d01d360f5c402088dc1da4fb8debd0` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.710331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d01d360f5c402088dc1da4fb8debd0)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.712281 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.762575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d01d360f5c402088dc1da4fb8debd0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.763278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d01d360f5c402088dc1da4fb8debd0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.776836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d01d360f5c402088dc1da4fb8debd0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.784827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d01d360f5c402088dc1da4fb8debd0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.785454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-6273076b-b5ec-46e1-a306-263aab3c30bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d01d360f5c402088dc1da4fb8debd0'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:45.798022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1297/2587] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:52:45 2022] DELETE /identity/v3/users/01d01d360f5c402088dc1da4fb8debd0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:46.071382 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.072855 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:46.096027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa75b8-1f90-4c73-99ec-d32712b49e86 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.164484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.165189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.165415 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.165685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] PATH_INFO: `/v3/projects/32d508596d9f4bbb9d8b56cd39f22f33` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.166850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d508596d9f4bbb9d8b56cd39f22f33)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.168759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.219990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d508596d9f4bbb9d8b56cd39f22f33', 'request_id': 'req-ae3231ee-6e1e-4035-8f03-b841942b9b8f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:46.226340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d508596d9f4bbb9d8b56cd39f22f33', 'request_id': 'req-ae3231ee-6e1e-4035-8f03-b841942b9b8f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:46.234225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d508596d9f4bbb9d8b56cd39f22f33', 'request_id': 'req-ae3231ee-6e1e-4035-8f03-b841942b9b8f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:46.245036 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] The token cache is being invalidate because project 32d508596d9f4bbb9d8b56cd39f22f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:52:46.245322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:46.245945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ae3231ee-6e1e-4035-8f03-b841942b9b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:46.247449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1291/2588] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:52:46 2022] DELETE /identity/v3/projects/32d508596d9f4bbb9d8b56cd39f22f33 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:46.252302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750c978-ce9d-4fc0-aba1-29ea0c44d101 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.252588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750c978-ce9d-4fc0-aba1-29ea0c44d101 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.252866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750c978-ce9d-4fc0-aba1-29ea0c44d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.274047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f750c978-ce9d-4fc0-aba1-29ea0c44d101 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:46.275310 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f750c978-ce9d-4fc0-aba1-29ea0c44d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:46.338016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1298/2589] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:46.346336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d6e6c-943d-45d6-8435-7965a0d0e405 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.346619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d6e6c-943d-45d6-8435-7965a0d0e405 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.346935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d6e6c-943d-45d6-8435-7965a0d0e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.368363 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-cb7d6e6c-943d-45d6-8435-7965a0d0e405 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:46.369608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cb7d6e6c-943d-45d6-8435-7965a0d0e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:46.379540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1292/2590] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:46.384418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750c978-ce9d-4fc0-aba1-29ea0c44d101 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.395293 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750c978-ce9d-4fc0-aba1-29ea0c44d101 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.400102 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080929bd-75d8-465b-a4aa-a70e403fd14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.400850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080929bd-75d8-465b-a4aa-a70e403fd14b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.401363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080929bd-75d8-465b-a4aa-a70e403fd14b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.401732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080929bd-75d8-465b-a4aa-a70e403fd14b admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.402477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080929bd-75d8-465b-a4aa-a70e403fd14b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:46.402948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080929bd-75d8-465b-a4aa-a70e403fd14b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.404636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080929bd-75d8-465b-a4aa-a70e403fd14b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.422265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1299/2591] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:46.423533 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d6e6c-943d-45d6-8435-7965a0d0e405 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.433592 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d6e6c-943d-45d6-8435-7965a0d0e405 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.438862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebcadf-3003-4b19-9bee-3e6cc122aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.439761 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebcadf-3003-4b19-9bee-3e6cc122aa92 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.440049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebcadf-3003-4b19-9bee-3e6cc122aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.442874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebcadf-3003-4b19-9bee-3e6cc122aa92 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.442874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebcadf-3003-4b19-9bee-3e6cc122aa92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.443277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebcadf-3003-4b19-9bee-3e6cc122aa92 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.477900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1293/2592] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:46.482264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080929bd-75d8-465b-a4aa-a70e403fd14b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.493016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080929bd-75d8-465b-a4aa-a70e403fd14b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.522430 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.554505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a79722-5636-468b-883f-ede69085da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.555387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79722-5636-468b-883f-ede69085da0f admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.555669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79722-5636-468b-883f-ede69085da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.556128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79722-5636-468b-883f-ede69085da0f admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.556994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a79722-5636-468b-883f-ede69085da0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.558967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a79722-5636-468b-883f-ede69085da0f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.581701 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1300/2593] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:46.585983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebcadf-3003-4b19-9bee-3e6cc122aa92 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.597310 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebcadf-3003-4b19-9bee-3e6cc122aa92 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.603704 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a3a68-cd30-4f31-836f-7a5d43f2928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.605009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a3a68-cd30-4f31-836f-7a5d43f2928c admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.605009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a3a68-cd30-4f31-836f-7a5d43f2928c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.605009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a3a68-cd30-4f31-836f-7a5d43f2928c admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.605782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a3a68-cd30-4f31-836f-7a5d43f2928c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.607527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a3a68-cd30-4f31-836f-7a5d43f2928c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.619562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1294/2594] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:46.623652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a79722-5636-468b-883f-ede69085da0f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.634707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a79722-5636-468b-883f-ede69085da0f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.640106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9552414-088b-43b0-8a7f-2962a9eea08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.640888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552414-088b-43b0-8a7f-2962a9eea08d admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.641167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552414-088b-43b0-8a7f-2962a9eea08d admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.641437 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552414-088b-43b0-8a7f-2962a9eea08d admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.642076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9552414-088b-43b0-8a7f-2962a9eea08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.643730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9552414-088b-43b0-8a7f-2962a9eea08d admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.654905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1301/2595] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:52:46.659408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a3a68-cd30-4f31-836f-7a5d43f2928c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.669759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a3a68-cd30-4f31-836f-7a5d43f2928c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.675339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af06cc8-ea44-4200-b599-73571eef7a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.676012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06cc8-ea44-4200-b599-73571eef7a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.676294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06cc8-ea44-4200-b599-73571eef7a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.676572 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06cc8-ea44-4200-b599-73571eef7a9d admin admin] PATH_INFO: `/v3/projects/2d64604c436446b3babdc9aebb5c1d48/users/17b340c8bfd644a6971c42a88340f9fa/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.692961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af06cc8-ea44-4200-b599-73571eef7a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d64604c436446b3babdc9aebb5c1d48, user_id=17b340c8bfd644a6971c42a88340f9fa, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.695666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af06cc8-ea44-4200-b599-73571eef7a9d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.699381 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.713525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1295/2596] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:46 2022] PUT /identity/v3/projects/2d64604c436446b3babdc9aebb5c1d48/users/17b340c8bfd644a6971c42a88340f9fa/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:46.725577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6cd3f-5820-4e9f-b9e1-7c7b93b3fc01 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.725862 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6cd3f-5820-4e9f-b9e1-7c7b93b3fc01 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.726141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6cd3f-5820-4e9f-b9e1-7c7b93b3fc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.756948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f1d6cd3f-5820-4e9f-b9e1-7c7b93b3fc01 None None] MFA Rules not processed for user `17b340c8bfd644a6971c42a88340f9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:46.758264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f1d6cd3f-5820-4e9f-b9e1-7c7b93b3fc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:46.831472 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1302/2597] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:46.835881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af06cc8-ea44-4200-b599-73571eef7a9d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.902535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af06cc8-ea44-4200-b599-73571eef7a9d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.907694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4818-00bb-4c63-ad17-69946bf177a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.908306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4818-00bb-4c63-ad17-69946bf177a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.908586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4818-00bb-4c63-ad17-69946bf177a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.908890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4818-00bb-4c63-ad17-69946bf177a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.909591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be4818-00bb-4c63-ad17-69946bf177a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.911714 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be4818-00bb-4c63-ad17-69946bf177a9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.941721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1296/2598] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:46.945695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6cd3f-5820-4e9f-b9e1-7c7b93b3fc01 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.957830 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6cd3f-5820-4e9f-b9e1-7c7b93b3fc01 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.017581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415b93b-a3db-4f40-9e87-c3212f4403fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.018205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b93b-a3db-4f40-9e87-c3212f4403fc admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.018487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b93b-a3db-4f40-9e87-c3212f4403fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.018759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b93b-a3db-4f40-9e87-c3212f4403fc admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.019467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415b93b-a3db-4f40-9e87-c3212f4403fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.021453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415b93b-a3db-4f40-9e87-c3212f4403fc admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.044253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1303/2599] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:47.049345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4818-00bb-4c63-ad17-69946bf177a9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.060516 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4818-00bb-4c63-ad17-69946bf177a9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.067046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980da32-1bb5-479e-8883-bf5552ed38cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.067865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980da32-1bb5-479e-8883-bf5552ed38cf admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.068241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980da32-1bb5-479e-8883-bf5552ed38cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.068655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980da32-1bb5-479e-8883-bf5552ed38cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.069401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980da32-1bb5-479e-8883-bf5552ed38cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.071902 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980da32-1bb5-479e-8883-bf5552ed38cf admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.096707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1297/2600] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:47.098256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415b93b-a3db-4f40-9e87-c3212f4403fc admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.109371 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415b93b-a3db-4f40-9e87-c3212f4403fc admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.114991 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a3a4-2743-4a0e-a3c6-2bb47a6b19d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.116366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a3a4-2743-4a0e-a3c6-2bb47a6b19d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.116366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a3a4-2743-4a0e-a3c6-2bb47a6b19d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.116605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a3a4-2743-4a0e-a3c6-2bb47a6b19d3 admin admin] PATH_INFO: `/v3/projects/7668edc4c5bd498ab23aff190bb9175b/users/beee38f86f4f4c59878234d1cec1a4fc/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.134838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2a3a4-2743-4a0e-a3c6-2bb47a6b19d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7668edc4c5bd498ab23aff190bb9175b, user_id=beee38f86f4f4c59878234d1cec1a4fc, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.137585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2a3a4-2743-4a0e-a3c6-2bb47a6b19d3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.153179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1304/2601] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:47 2022] PUT /identity/v3/projects/7668edc4c5bd498ab23aff190bb9175b/users/beee38f86f4f4c59878234d1cec1a4fc/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:47.158543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980da32-1bb5-479e-8883-bf5552ed38cf admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.168508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980da32-1bb5-479e-8883-bf5552ed38cf admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.227117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db015e9-0b72-40c0-aab9-4dccea357a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.227634 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db015e9-0b72-40c0-aab9-4dccea357a36 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.227908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db015e9-0b72-40c0-aab9-4dccea357a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.228177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db015e9-0b72-40c0-aab9-4dccea357a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.228803 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db015e9-0b72-40c0-aab9-4dccea357a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.230389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db015e9-0b72-40c0-aab9-4dccea357a36 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.240928 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1298/2602] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:52:47.245044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a3a4-2743-4a0e-a3c6-2bb47a6b19d3 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.251499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:47.257190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a3a4-2743-4a0e-a3c6-2bb47a6b19d3 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.263888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5a1d5-6678-4d03-abb3-0b5dcea240d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.265933 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5a1d5-6678-4d03-abb3-0b5dcea240d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.266291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5a1d5-6678-4d03-abb3-0b5dcea240d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.266575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5a1d5-6678-4d03-abb3-0b5dcea240d7 admin admin] PATH_INFO: `/v3/projects/7668edc4c5bd498ab23aff190bb9175b/users/beee38f86f4f4c59878234d1cec1a4fc/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.268604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5a1d5-6678-4d03-abb3-0b5dcea240d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7668edc4c5bd498ab23aff190bb9175b, user_id=beee38f86f4f4c59878234d1cec1a4fc, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.271302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5a1d5-6678-4d03-abb3-0b5dcea240d7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.283247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1305/2603] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:47 2022] PUT /identity/v3/projects/7668edc4c5bd498ab23aff190bb9175b/users/beee38f86f4f4c59878234d1cec1a4fc/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:47.293263 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efb3f4-8230-47ef-9140-38bbed4179a0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.293551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efb3f4-8230-47ef-9140-38bbed4179a0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.293830 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efb3f4-8230-47ef-9140-38bbed4179a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.324529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d0efb3f4-8230-47ef-9140-38bbed4179a0 None None] MFA Rules not processed for user `beee38f86f4f4c59878234d1cec1a4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:47.325793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d0efb3f4-8230-47ef-9140-38bbed4179a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:47.388992 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:47.420834 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1299/2604] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:47.421603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5a1d5-6678-4d03-abb3-0b5dcea240d7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.422199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-dff5a1d5-6678-4d03-abb3-0b5dcea240d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:47.482812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5a1d5-6678-4d03-abb3-0b5dcea240d7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.486707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5cbd1-d7c4-4e33-b589-67e4c789f2a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.487363 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5cbd1-d7c4-4e33-b589-67e4c789f2a8 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.487644 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5cbd1-d7c4-4e33-b589-67e4c789f2a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.487915 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5cbd1-d7c4-4e33-b589-67e4c789f2a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.498002 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5cbd1-d7c4-4e33-b589-67e4c789f2a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.500505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5cbd1-d7c4-4e33-b589-67e4c789f2a8 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.511032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1306/2605] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:47.619185 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efb3f4-8230-47ef-9140-38bbed4179a0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.630155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efb3f4-8230-47ef-9140-38bbed4179a0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.634246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c5c6-1603-46e9-b4ad-759e713fbfd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.634891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c5c6-1603-46e9-b4ad-759e713fbfd9 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.635172 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c5c6-1603-46e9-b4ad-759e713fbfd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.635446 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c5c6-1603-46e9-b4ad-759e713fbfd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.695277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63c5c6-1603-46e9-b4ad-759e713fbfd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.696720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63c5c6-1603-46e9-b4ad-759e713fbfd9 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.706064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1300/2606] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:50.305119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5cbd1-d7c4-4e33-b589-67e4c789f2a8 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.372940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5cbd1-d7c4-4e33-b589-67e4c789f2a8 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.378685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.379353 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.379634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.379908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] PATH_INFO: `/v3/users/17b340c8bfd644a6971c42a88340f9fa` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.381041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b340c8bfd644a6971c42a88340f9fa)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.383262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.432400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b340c8bfd644a6971c42a88340f9fa'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:50.433063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b340c8bfd644a6971c42a88340f9fa'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:50.450637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b340c8bfd644a6971c42a88340f9fa'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:50.460069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b340c8bfd644a6971c42a88340f9fa'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:50.461090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b340c8bfd644a6971c42a88340f9fa'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:50.476886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1307/2607] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:52:50 2022] DELETE /identity/v3/users/17b340c8bfd644a6971c42a88340f9fa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:50.481458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfbad3-9ca6-4215-a743-8aa13afc2dc1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.481934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfbad3-9ca6-4215-a743-8aa13afc2dc1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.482060 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfbad3-9ca6-4215-a743-8aa13afc2dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.502224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-60dfbad3-9ca6-4215-a743-8aa13afc2dc1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:50.503474 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-60dfbad3-9ca6-4215-a743-8aa13afc2dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:50.564068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1301/2608] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:50.573663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.575108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:50.589296 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.638888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df7082-394f-4e14-ab29-57b6f084909c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.642678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2863f-c45b-401a-bbb5-9acf1ba884da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.643315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2863f-c45b-401a-bbb5-9acf1ba884da service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.643589 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2863f-c45b-401a-bbb5-9acf1ba884da service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.643854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2863f-c45b-401a-bbb5-9acf1ba884da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.652865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2863f-c45b-401a-bbb5-9acf1ba884da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.654280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2863f-c45b-401a-bbb5-9acf1ba884da service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.664538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1308/2609] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:52:50.947316 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfbad3-9ca6-4215-a743-8aa13afc2dc1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.948757 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-60dfbad3-9ca6-4215-a743-8aa13afc2dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:50.964410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfbad3-9ca6-4215-a743-8aa13afc2dc1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.970380 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.971235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.971676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.972040 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] PATH_INFO: `/v3/projects/2d64604c436446b3babdc9aebb5c1d48` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.973741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d64604c436446b3babdc9aebb5c1d48)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.977791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.039963 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d64604c436446b3babdc9aebb5c1d48', 'request_id': 'req-0f11058a-60ac-4b80-96e5-dfe0968564f3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.050177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d64604c436446b3babdc9aebb5c1d48', 'request_id': 'req-0f11058a-60ac-4b80-96e5-dfe0968564f3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.059595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d64604c436446b3babdc9aebb5c1d48', 'request_id': 'req-0f11058a-60ac-4b80-96e5-dfe0968564f3'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.073972 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] The token cache is being invalidate because project 2d64604c436446b3babdc9aebb5c1d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:52:51.074188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.074931 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.076661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1302/2610] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:52:50 2022] DELETE /identity/v3/projects/2d64604c436446b3babdc9aebb5c1d48 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:51.081497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2863f-c45b-401a-bbb5-9acf1ba884da service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.096341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2863f-c45b-401a-bbb5-9acf1ba884da service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.168709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.170122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.171463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.172685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] PATH_INFO: `/v3/users/beee38f86f4f4c59878234d1cec1a4fc` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.174146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beee38f86f4f4c59878234d1cec1a4fc)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.177240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.257981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beee38f86f4f4c59878234d1cec1a4fc'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.258668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beee38f86f4f4c59878234d1cec1a4fc'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.273790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beee38f86f4f4c59878234d1cec1a4fc'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.282633 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beee38f86f4f4c59878234d1cec1a4fc'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.283455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-3bd69f7a-89ef-44f8-9988-7c489493b3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beee38f86f4f4c59878234d1cec1a4fc'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.298255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1309/2611] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:52:51 2022] DELETE /identity/v3/users/beee38f86f4f4c59878234d1cec1a4fc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:51.578045 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.579557 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:51.595812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11058a-60ac-4b80-96e5-dfe0968564f3 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.605734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.657413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.657974 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.658311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.658508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] PATH_INFO: `/v3/projects/7668edc4c5bd498ab23aff190bb9175b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.659659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7668edc4c5bd498ab23aff190bb9175b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.661563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.708227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7668edc4c5bd498ab23aff190bb9175b', 'request_id': 'req-998a7c9b-320e-4786-84f7-d75d114fa59b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.714223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7668edc4c5bd498ab23aff190bb9175b', 'request_id': 'req-998a7c9b-320e-4786-84f7-d75d114fa59b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.722845 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7668edc4c5bd498ab23aff190bb9175b', 'request_id': 'req-998a7c9b-320e-4786-84f7-d75d114fa59b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.733675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] The token cache is being invalidate because project 7668edc4c5bd498ab23aff190bb9175b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:52:51.733854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.734488 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-998a7c9b-320e-4786-84f7-d75d114fa59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:52:51.736205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1303/2612] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:52:51 2022] DELETE /identity/v3/projects/7668edc4c5bd498ab23aff190bb9175b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:51.741039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248e8b-2238-42e1-9c91-d50a7e9d7900 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.741503 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248e8b-2238-42e1-9c91-d50a7e9d7900 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.741596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248e8b-2238-42e1-9c91-d50a7e9d7900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.763199 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-82248e8b-2238-42e1-9c91-d50a7e9d7900 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:51.765229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-82248e8b-2238-42e1-9c91-d50a7e9d7900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:51.794847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.827308 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1310/2613] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:51.835930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713428b-17ee-4449-b20c-01c75c15e300 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.836267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713428b-17ee-4449-b20c-01c75c15e300 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.836546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713428b-17ee-4449-b20c-01c75c15e300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.856077 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7713428b-17ee-4449-b20c-01c75c15e300 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:51.857305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7713428b-17ee-4449-b20c-01c75c15e300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:51.865194 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1304/2614] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:51.877631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82248e8b-2238-42e1-9c91-d50a7e9d7900 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.887720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82248e8b-2238-42e1-9c91-d50a7e9d7900 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.893386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662d530-b9d0-4c13-8597-9df11360df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.893993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662d530-b9d0-4c13-8597-9df11360df47 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.894272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662d530-b9d0-4c13-8597-9df11360df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.894547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662d530-b9d0-4c13-8597-9df11360df47 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.895222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662d530-b9d0-4c13-8597-9df11360df47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:51.895524 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662d530-b9d0-4c13-8597-9df11360df47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.897114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662d530-b9d0-4c13-8597-9df11360df47 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.908902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1311/2615] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:51.913350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713428b-17ee-4449-b20c-01c75c15e300 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.923098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713428b-17ee-4449-b20c-01c75c15e300 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.927967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72274a3-5c92-466c-a06c-a9cc2046234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.928739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72274a3-5c92-466c-a06c-a9cc2046234c admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.928910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72274a3-5c92-466c-a06c-a9cc2046234c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.929182 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72274a3-5c92-466c-a06c-a9cc2046234c admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.929814 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72274a3-5c92-466c-a06c-a9cc2046234c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.931798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72274a3-5c92-466c-a06c-a9cc2046234c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.960323 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1305/2616] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:52:51 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:51.964828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662d530-b9d0-4c13-8597-9df11360df47 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.975010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662d530-b9d0-4c13-8597-9df11360df47 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.033855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235dc3d-3347-41cb-a76a-73ddae80dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.034454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235dc3d-3347-41cb-a76a-73ddae80dc63 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.034728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235dc3d-3347-41cb-a76a-73ddae80dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.035028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235dc3d-3347-41cb-a76a-73ddae80dc63 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.035646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235dc3d-3347-41cb-a76a-73ddae80dc63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.037549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235dc3d-3347-41cb-a76a-73ddae80dc63 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.059239 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1312/2617] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:52:51 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:52.063966 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72274a3-5c92-466c-a06c-a9cc2046234c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.074351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72274a3-5c92-466c-a06c-a9cc2046234c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.079731 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31f46a-1f22-4e47-9a4c-aba469d83c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.080335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f46a-1f22-4e47-9a4c-aba469d83c16 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.080615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f46a-1f22-4e47-9a4c-aba469d83c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.080892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f46a-1f22-4e47-9a4c-aba469d83c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.081531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31f46a-1f22-4e47-9a4c-aba469d83c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.083170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31f46a-1f22-4e47-9a4c-aba469d83c16 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.093179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1306/2618] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:52.097215 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235dc3d-3347-41cb-a76a-73ddae80dc63 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.107189 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235dc3d-3347-41cb-a76a-73ddae80dc63 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.112383 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447040-c6a8-4274-812a-3248551e30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.112978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447040-c6a8-4274-812a-3248551e30ea admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.113252 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447040-c6a8-4274-812a-3248551e30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.113519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447040-c6a8-4274-812a-3248551e30ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.114157 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63447040-c6a8-4274-812a-3248551e30ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.115752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63447040-c6a8-4274-812a-3248551e30ea admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.126906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1313/2619] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:52:52.131096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31f46a-1f22-4e47-9a4c-aba469d83c16 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.141501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31f46a-1f22-4e47-9a4c-aba469d83c16 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.146201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733254c-2716-4e2b-801c-41fdce2d4e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.146881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733254c-2716-4e2b-801c-41fdce2d4e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.147163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733254c-2716-4e2b-801c-41fdce2d4e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.147438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733254c-2716-4e2b-801c-41fdce2d4e88 admin admin] PATH_INFO: `/v3/projects/f0ffc07eb72a4c28bf93e54f45a4e605/users/6dc2960e23114ebba4043cc9218bd200/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.163214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733254c-2716-4e2b-801c-41fdce2d4e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ffc07eb72a4c28bf93e54f45a4e605, user_id=6dc2960e23114ebba4043cc9218bd200, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.165791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733254c-2716-4e2b-801c-41fdce2d4e88 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.179618 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1307/2620] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:52:52 2022] PUT /identity/v3/projects/f0ffc07eb72a4c28bf93e54f45a4e605/users/6dc2960e23114ebba4043cc9218bd200/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:52.191872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4acc95-62e0-4e14-8dc3-b60afd8f73d3 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.192172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4acc95-62e0-4e14-8dc3-b60afd8f73d3 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.192424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4acc95-62e0-4e14-8dc3-b60afd8f73d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.220311 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3d4acc95-62e0-4e14-8dc3-b60afd8f73d3 None None] MFA Rules not processed for user `6dc2960e23114ebba4043cc9218bd200`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:52.221549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3d4acc95-62e0-4e14-8dc3-b60afd8f73d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:52.296098 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1314/2621] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:52:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:52:52.307389 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733254c-2716-4e2b-801c-41fdce2d4e88 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.309856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9733254c-2716-4e2b-801c-41fdce2d4e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:52.361416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.379213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733254c-2716-4e2b-801c-41fdce2d4e88 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.383258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751432-2314-4cd7-8e94-3e7143a2b335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.383882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751432-2314-4cd7-8e94-3e7143a2b335 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.384159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751432-2314-4cd7-8e94-3e7143a2b335 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.384428 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751432-2314-4cd7-8e94-3e7143a2b335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.393663 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5751432-2314-4cd7-8e94-3e7143a2b335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.395200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5751432-2314-4cd7-8e94-3e7143a2b335 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.405330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1308/2622] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:02.292670 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.401819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=8 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.644407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e5dbb-e4a7-4447-823b-9f97e1aba6ec None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.644907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e5dbb-e4a7-4447-823b-9f97e1aba6ec None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.645186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e5dbb-e4a7-4447-823b-9f97e1aba6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.667294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-187e5dbb-e4a7-4447-823b-9f97e1aba6ec None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:08.668528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-187e5dbb-e4a7-4447-823b-9f97e1aba6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:08.729244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1315/2623] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:08.777697 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751432-2314-4cd7-8e94-3e7143a2b335 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.779135 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e5751432-2314-4cd7-8e94-3e7143a2b335 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:08.856754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751432-2314-4cd7-8e94-3e7143a2b335 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.863951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6eab9-da9e-489f-ae81-8bba1ee53ed9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.864569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6eab9-da9e-489f-ae81-8bba1ee53ed9 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.864850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6eab9-da9e-489f-ae81-8bba1ee53ed9 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.865124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6eab9-da9e-489f-ae81-8bba1ee53ed9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.875951 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6eab9-da9e-489f-ae81-8bba1ee53ed9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.878309 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6eab9-da9e-489f-ae81-8bba1ee53ed9 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.886892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1309/2624] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:53:10.952089 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e5dbb-e4a7-4447-823b-9f97e1aba6ec None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.956466 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-187e5dbb-e4a7-4447-823b-9f97e1aba6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:11.071130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e5dbb-e4a7-4447-823b-9f97e1aba6ec None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.079855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.080782 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.081251 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.081701 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.083836 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:11.185477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.189558 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.208945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1316/2625] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:18.883168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=32 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:19.466954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6eab9-da9e-489f-ae81-8bba1ee53ed9 service swift] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.468430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-71b6eab9-da9e-489f-ae81-8bba1ee53ed9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.532011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6eab9-da9e-489f-ae81-8bba1ee53ed9 service swift] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.535649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bea5df-03ef-4a39-a09c-bab32a48a427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.536205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bea5df-03ef-4a39-a09c-bab32a48a427 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.536482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bea5df-03ef-4a39-a09c-bab32a48a427 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.536728 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bea5df-03ef-4a39-a09c-bab32a48a427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.542721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-41bea5df-03ef-4a39-a09c-bab32a48a427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.554897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bea5df-03ef-4a39-a09c-bab32a48a427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.556354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bea5df-03ef-4a39-a09c-bab32a48a427 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.567900 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1310/2626] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:20.583447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.585537 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:20.602297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0803b-ef9a-4cab-b380-e8f4b5ca7eaa service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.623058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4169c4-9fe0-4411-b998-2759b11ac918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.623058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4169c4-9fe0-4411-b998-2759b11ac918 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.623058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4169c4-9fe0-4411-b998-2759b11ac918 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.623058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4169c4-9fe0-4411-b998-2759b11ac918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.623457 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7e4169c4-9fe0-4411-b998-2759b11ac918 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:20.640542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4169c4-9fe0-4411-b998-2759b11ac918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.642344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4169c4-9fe0-4411-b998-2759b11ac918 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.657669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1317/2627] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:23.287196 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bea5df-03ef-4a39-a09c-bab32a48a427 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.313192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bea5df-03ef-4a39-a09c-bab32a48a427 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.320264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262133b-b6e9-4aa3-9e7c-971ec4315187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.320938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262133b-b6e9-4aa3-9e7c-971ec4315187 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.321401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262133b-b6e9-4aa3-9e7c-971ec4315187 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.321653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262133b-b6e9-4aa3-9e7c-971ec4315187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.323538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2262133b-b6e9-4aa3-9e7c-971ec4315187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:23.343599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262133b-b6e9-4aa3-9e7c-971ec4315187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.347337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262133b-b6e9-4aa3-9e7c-971ec4315187 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.363656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1311/2628] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:23.673995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4169c4-9fe0-4411-b998-2759b11ac918 service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.705984 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.740787 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4169c4-9fe0-4411-b998-2759b11ac918 service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.745394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.746173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.746455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.746728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] PATH_INFO: `/v3/users/6dc2960e23114ebba4043cc9218bd200` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.748133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc2960e23114ebba4043cc9218bd200)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.750614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.808790 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc2960e23114ebba4043cc9218bd200'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:23.810158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc2960e23114ebba4043cc9218bd200'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:23.830233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc2960e23114ebba4043cc9218bd200'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:23.838514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc2960e23114ebba4043cc9218bd200'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:23.839520 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc2960e23114ebba4043cc9218bd200'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:23.854130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1318/2629] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:23 2022] DELETE /identity/v3/users/6dc2960e23114ebba4043cc9218bd200 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:23.859759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71555c-f4ad-44c4-ab10-08728a27d74c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.860050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71555c-f4ad-44c4-ab10-08728a27d74c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.860330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71555c-f4ad-44c4-ab10-08728a27d74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.882255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ce71555c-f4ad-44c4-ab10-08728a27d74c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:23.883660 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ce71555c-f4ad-44c4-ab10-08728a27d74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:23.946749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1312/2630] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:23.957793 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.959329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.028942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e5adb-f8c7-455b-9aa3-69eec2910ef8 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.029598 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e5adb-f8c7-455b-9aa3-69eec2910ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.030287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e5adb-f8c7-455b-9aa3-69eec2910ef8 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.031106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01422-784d-4216-bbbe-be86f13a155c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.033220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1313/2631] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:53:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:24.035243 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0752c5-01dc-4674-8d47-f05baea5675b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.035855 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0752c5-01dc-4674-8d47-f05baea5675b service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.036132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0752c5-01dc-4674-8d47-f05baea5675b service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.036400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0752c5-01dc-4674-8d47-f05baea5675b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.039614 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f345b-96ee-4f96-a75d-be231719480e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.040280 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f345b-96ee-4f96-a75d-be231719480e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.040708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f345b-96ee-4f96-a75d-be231719480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.046456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0752c5-01dc-4674-8d47-f05baea5675b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.048040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0752c5-01dc-4674-8d47-f05baea5675b service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.058669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1319/2632] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:24.067083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ed3f345b-96ee-4f96-a75d-be231719480e None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:24.068308 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ed3f345b-96ee-4f96-a75d-be231719480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.163178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1314/2633] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:24.177086 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0752c5-01dc-4674-8d47-f05baea5675b service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.178617 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-dd0752c5-01dc-4674-8d47-f05baea5675b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.245081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0752c5-01dc-4674-8d47-f05baea5675b service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.248908 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbcd70-e923-45c5-9998-ce2c24f698da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d4e9baa7a6241b1807c67844c7d424c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.249521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbcd70-e923-45c5-9998-ce2c24f698da service glance] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.249801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbcd70-e923-45c5-9998-ce2c24f698da service glance] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.250074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbcd70-e923-45c5-9998-ce2c24f698da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.257421 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.262288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbcd70-e923-45c5-9998-ce2c24f698da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.264567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbcd70-e923-45c5-9998-ce2c24f698da service glance] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.277577 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1320/2634] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:24.362475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f345b-96ee-4f96-a75d-be231719480e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.365101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ed3f345b-96ee-4f96-a75d-be231719480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.367773 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d974f-cd47-41d7-9b5f-c911eef5a9c0 None None] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.368066 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d974f-cd47-41d7-9b5f-c911eef5a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.368351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d974f-cd47-41d7-9b5f-c911eef5a9c0 None None] PATH_INFO: `/` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.370068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1321/2635] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:24.375471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f626-3b82-4423-88c0-f6648cb26581 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.375756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f626-3b82-4423-88c0-f6648cb26581 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.376058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f626-3b82-4423-88c0-f6648cb26581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.401499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b959f626-3b82-4423-88c0-f6648cb26581 None None] MFA Rules not processed for user `c13c571a4bd24335b8b149825bd79d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:24.402717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b959f626-3b82-4423-88c0-f6648cb26581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.412827 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1322/2636] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:24.420769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f345b-96ee-4f96-a75d-be231719480e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.425212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959f626-3b82-4423-88c0-f6648cb26581 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.427020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b959f626-3b82-4423-88c0-f6648cb26581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.427244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.427969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.428170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.428447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] PATH_INFO: `/v3/projects/f0ffc07eb72a4c28bf93e54f45a4e605` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.431033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ffc07eb72a4c28bf93e54f45a4e605)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.437107 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.441973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959f626-3b82-4423-88c0-f6648cb26581 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.445912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be621c-d301-4cb7-ba4d-1c6e98afac2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.446798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be621c-d301-4cb7-ba4d-1c6e98afac2a service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.446940 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be621c-d301-4cb7-ba4d-1c6e98afac2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.447127 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be621c-d301-4cb7-ba4d-1c6e98afac2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.455764 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.457668 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be621c-d301-4cb7-ba4d-1c6e98afac2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.459337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be621c-d301-4cb7-ba4d-1c6e98afac2a service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.468483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1323/2637] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:24.496191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ffc07eb72a4c28bf93e54f45a4e605', 'request_id': 'req-de126ec9-02b9-4c15-8886-51ea32a63825'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:24.506952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ffc07eb72a4c28bf93e54f45a4e605', 'request_id': 'req-de126ec9-02b9-4c15-8886-51ea32a63825'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:24.517710 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ffc07eb72a4c28bf93e54f45a4e605', 'request_id': 'req-de126ec9-02b9-4c15-8886-51ea32a63825'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:24.533974 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] The token cache is being invalidate because project f0ffc07eb72a4c28bf93e54f45a4e605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:24.534328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:24.535130 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-de126ec9-02b9-4c15-8886-51ea32a63825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:24.538205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1315/2638] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:24 2022] DELETE /identity/v3/projects/f0ffc07eb72a4c28bf93e54f45a4e605 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:24.542259 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020201cb-8222-4865-9432-5389da21c4b8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.542432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020201cb-8222-4865-9432-5389da21c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.542752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020201cb-8222-4865-9432-5389da21c4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.579585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3212-1d25-47d2-b6aa-d8cad60c93d5 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.580050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3212-1d25-47d2-b6aa-d8cad60c93d5 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.580050 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3212-1d25-47d2-b6aa-d8cad60c93d5 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.581484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1316/2639] 10.222.0.65 () {54 vars in 921 bytes} [Thu Aug 18 20:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:24.588013 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e366a1-0078-4267-bc20-656601ff051b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.588300 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e366a1-0078-4267-bc20-656601ff051b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.588633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e366a1-0078-4267-bc20-656601ff051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.612443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-22e366a1-0078-4267-bc20-656601ff051b None None] MFA Rules not processed for user `d6e704b8291b4934a20cdde2ef127493`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:24.614219 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-22e366a1-0078-4267-bc20-656601ff051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.692121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-020201cb-8222-4865-9432-5389da21c4b8 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:24.693354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-020201cb-8222-4865-9432-5389da21c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.695068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1317/2640] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Aug 18 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:24.710061 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e366a1-0078-4267-bc20-656601ff051b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.711541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-22e366a1-0078-4267-bc20-656601ff051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.759133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1324/2641] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:24.768231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2e180-b711-484e-b195-bfc856d67783 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.768510 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2e180-b711-484e-b195-bfc856d67783 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.768777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2e180-b711-484e-b195-bfc856d67783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.769981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e366a1-0078-4267-bc20-656601ff051b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.773632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2272ce-1326-412d-b4c6-34cf27adb462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.774235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2272ce-1326-412d-b4c6-34cf27adb462 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.774514 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2272ce-1326-412d-b4c6-34cf27adb462 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.774804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2272ce-1326-412d-b4c6-34cf27adb462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.785097 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2272ce-1326-412d-b4c6-34cf27adb462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.786539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2272ce-1326-412d-b4c6-34cf27adb462 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.787826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-6ee2e180-b711-484e-b195-bfc856d67783 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:24.789036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6ee2e180-b711-484e-b195-bfc856d67783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.797433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1318/2642] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:24.797683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1325/2643] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:24.801776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2272ce-1326-412d-b4c6-34cf27adb462 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.813314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2272ce-1326-412d-b4c6-34cf27adb462 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.817911 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.818511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.818817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.819090 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.819729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:24.820031 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.821617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.834517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1319/2644] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:24.838861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2e180-b711-484e-b195-bfc856d67783 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.851913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2e180-b711-484e-b195-bfc856d67783 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.856609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6da6f-e41e-4687-8632-1822b8e70dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.857209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6da6f-e41e-4687-8632-1822b8e70dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.857487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6da6f-e41e-4687-8632-1822b8e70dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.857786 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6da6f-e41e-4687-8632-1822b8e70dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.858409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6da6f-e41e-4687-8632-1822b8e70dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.860414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6da6f-e41e-4687-8632-1822b8e70dd6 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.864870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.866809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.893599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1326/2645] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:24 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:24.897783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6da6f-e41e-4687-8632-1822b8e70dd6 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.900915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.946798 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c899e-ac37-4912-9f4e-e62e980ef0d3 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.965116 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6da6f-e41e-4687-8632-1822b8e70dd6 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.970511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b8e1f-edf7-4432-afa3-9e16c10b493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.971147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b8e1f-edf7-4432-afa3-9e16c10b493f admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.971418 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b8e1f-edf7-4432-afa3-9e16c10b493f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.971687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b8e1f-edf7-4432-afa3-9e16c10b493f admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.972304 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b8e1f-edf7-4432-afa3-9e16c10b493f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.974194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b8e1f-edf7-4432-afa3-9e16c10b493f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.996096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1327/2646] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:24 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:25.001397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b8e1f-edf7-4432-afa3-9e16c10b493f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.011656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655ccc-111e-4361-8f6e-cb10dd9455d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.011850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b8e1f-edf7-4432-afa3-9e16c10b493f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.012279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655ccc-111e-4361-8f6e-cb10dd9455d9 service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.012559 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655ccc-111e-4361-8f6e-cb10dd9455d9 service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.012836 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655ccc-111e-4361-8f6e-cb10dd9455d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.016000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-47655ccc-111e-4361-8f6e-cb10dd9455d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:25.017228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ee31-d6a3-4490-b877-14b235f830c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.017818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ee31-d6a3-4490-b877-14b235f830c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.018094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ee31-d6a3-4490-b877-14b235f830c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.018359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ee31-d6a3-4490-b877-14b235f830c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.019148 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4ee31-d6a3-4490-b877-14b235f830c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.020735 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4ee31-d6a3-4490-b877-14b235f830c7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.027507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655ccc-111e-4361-8f6e-cb10dd9455d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.029093 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655ccc-111e-4361-8f6e-cb10dd9455d9 service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.031528 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1328/2647] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:53:25.035561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ee31-d6a3-4490-b877-14b235f830c7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.041528 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1320/2648] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:25.045202 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ee31-d6a3-4490-b877-14b235f830c7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.050241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90354-f9ae-4fba-bca3-7da4810ae72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.050892 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90354-f9ae-4fba-bca3-7da4810ae72d admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.051169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90354-f9ae-4fba-bca3-7da4810ae72d admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.051438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90354-f9ae-4fba-bca3-7da4810ae72d admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.052071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac90354-f9ae-4fba-bca3-7da4810ae72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.053623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac90354-f9ae-4fba-bca3-7da4810ae72d admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.065294 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1329/2649] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:53:25.069518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655ccc-111e-4361-8f6e-cb10dd9455d9 service placement] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.081285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655ccc-111e-4361-8f6e-cb10dd9455d9 service placement] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.085952 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972b02c-9011-4317-8ad6-1a254b1fe77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.086607 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972b02c-9011-4317-8ad6-1a254b1fe77c admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.086921 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972b02c-9011-4317-8ad6-1a254b1fe77c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.087201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972b02c-9011-4317-8ad6-1a254b1fe77c admin admin] PATH_INFO: `/v3/projects/f250e6aabfe24dffa9249ad9f3512a50/users/6832971a34de4eb39981c57152c7c5ae/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.103646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972b02c-9011-4317-8ad6-1a254b1fe77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f250e6aabfe24dffa9249ad9f3512a50, user_id=6832971a34de4eb39981c57152c7c5ae, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.106311 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972b02c-9011-4317-8ad6-1a254b1fe77c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.122285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1321/2650] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:25 2022] PUT /identity/v3/projects/f250e6aabfe24dffa9249ad9f3512a50/users/6832971a34de4eb39981c57152c7c5ae/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:25.127936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39606aeb-78cf-4be7-b4db-554039832178 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.128220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39606aeb-78cf-4be7-b4db-554039832178 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.128489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39606aeb-78cf-4be7-b4db-554039832178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.148643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-39606aeb-78cf-4be7-b4db-554039832178 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:25.150214 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-39606aeb-78cf-4be7-b4db-554039832178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:25.160921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:25.220338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1330/2651] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:25.231637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972b02c-9011-4317-8ad6-1a254b1fe77c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.297792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972b02c-9011-4317-8ad6-1a254b1fe77c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.301541 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92402b9b-2ac5-48fa-8aae-3fd3fe778721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.302223 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92402b9b-2ac5-48fa-8aae-3fd3fe778721 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.302597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92402b9b-2ac5-48fa-8aae-3fd3fe778721 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.302979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92402b9b-2ac5-48fa-8aae-3fd3fe778721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.313197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92402b9b-2ac5-48fa-8aae-3fd3fe778721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.316245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92402b9b-2ac5-48fa-8aae-3fd3fe778721 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.328731 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1322/2652] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:26.794551 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bd60f-c9ed-412d-9636-95550c812a49 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.795059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bd60f-c9ed-412d-9636-95550c812a49 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.795160 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bd60f-c9ed-412d-9636-95550c812a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.820606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-208bd60f-c9ed-412d-9636-95550c812a49 None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.821876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-208bd60f-c9ed-412d-9636-95550c812a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.899852 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1331/2653] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:26.924487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92402b9b-2ac5-48fa-8aae-3fd3fe778721 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.927960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-92402b9b-2ac5-48fa-8aae-3fd3fe778721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:27.034181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.083364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92402b9b-2ac5-48fa-8aae-3fd3fe778721 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.088923 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bd60f-c9ed-412d-9636-95550c812a49 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.089139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d1d5e-1fb5-4d97-9be0-b65993345926 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.089605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d1d5e-1fb5-4d97-9be0-b65993345926 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.090028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d1d5e-1fb5-4d97-9be0-b65993345926 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.090306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d1d5e-1fb5-4d97-9be0-b65993345926 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.090847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-208bd60f-c9ed-412d-9636-95550c812a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:27.100227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d1d5e-1fb5-4d97-9be0-b65993345926 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.101932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d1d5e-1fb5-4d97-9be0-b65993345926 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.109507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bd60f-c9ed-412d-9636-95550c812a49 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.114740 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1323/2654] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 20:53:27.126415 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f3fa9-a0b1-4de4-b80e-8af531fb3a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.127444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3fa9-a0b1-4de4-b80e-8af531fb3a13 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.131354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3fa9-a0b1-4de4-b80e-8af531fb3a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.131656 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3fa9-a0b1-4de4-b80e-8af531fb3a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.133647 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-cf2f3fa9-a0b1-4de4-b80e-8af531fb3a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:27.148463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f3fa9-a0b1-4de4-b80e-8af531fb3a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.151441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f3fa9-a0b1-4de4-b80e-8af531fb3a13 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.176228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1332/2655] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:32.380103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fad677-83e5-432a-9fc6-58c47dfaaab6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.384576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fad677-83e5-432a-9fc6-58c47dfaaab6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.384863 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fad677-83e5-432a-9fc6-58c47dfaaab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.436267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-28fad677-83e5-432a-9fc6-58c47dfaaab6 None None] MFA Rules not processed for user `6832971a34de4eb39981c57152c7c5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:32.442175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-28fad677-83e5-432a-9fc6-58c47dfaaab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:32.568970 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1324/2656] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:32.573912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f3fa9-a0b1-4de4-b80e-8af531fb3a13 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.598017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f3fa9-a0b1-4de4-b80e-8af531fb3a13 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.606962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd544a-a454-4cf4-a01c-a4e8e27787bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.610101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd544a-a454-4cf4-a01c-a4e8e27787bc admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.610101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd544a-a454-4cf4-a01c-a4e8e27787bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.610101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd544a-a454-4cf4-a01c-a4e8e27787bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.610101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd544a-a454-4cf4-a01c-a4e8e27787bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.611741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd544a-a454-4cf4-a01c-a4e8e27787bc admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.652241 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1333/2657] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:32 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:32.656685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fad677-83e5-432a-9fc6-58c47dfaaab6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.676960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fad677-83e5-432a-9fc6-58c47dfaaab6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.855345 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929daee6-4044-4b97-98f0-5505933068f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.856299 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929daee6-4044-4b97-98f0-5505933068f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.856716 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929daee6-4044-4b97-98f0-5505933068f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.857189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929daee6-4044-4b97-98f0-5505933068f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.858867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929daee6-4044-4b97-98f0-5505933068f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.862849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929daee6-4044-4b97-98f0-5505933068f1 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.913284 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1325/2658] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:32 2022] POST /identity/v3/users => generated 298 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:32.915205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd544a-a454-4cf4-a01c-a4e8e27787bc admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.957996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd544a-a454-4cf4-a01c-a4e8e27787bc admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.971553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1a731-0581-4af8-9ae8-3108b17f2b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.973035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a731-0581-4af8-9ae8-3108b17f2b40 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.973318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a731-0581-4af8-9ae8-3108b17f2b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.973599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a731-0581-4af8-9ae8-3108b17f2b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.974314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1a731-0581-4af8-9ae8-3108b17f2b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.979976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1a731-0581-4af8-9ae8-3108b17f2b40 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.998816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1334/2659] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:33.002046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929daee6-4044-4b97-98f0-5505933068f1 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.043930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929daee6-4044-4b97-98f0-5505933068f1 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.057708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406f4de-02d1-455f-ae98-1f244e5250d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.058443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406f4de-02d1-455f-ae98-1f244e5250d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.058722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406f4de-02d1-455f-ae98-1f244e5250d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.059063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406f4de-02d1-455f-ae98-1f244e5250d5 admin admin] PATH_INFO: `/v3/projects/8e4902559dbd4f0d8ec8cff760af6808/users/3354254906d646ccbec320ec63d003b8/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.097838 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406f4de-02d1-455f-ae98-1f244e5250d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4902559dbd4f0d8ec8cff760af6808, user_id=3354254906d646ccbec320ec63d003b8, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.100817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406f4de-02d1-455f-ae98-1f244e5250d5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.125865 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1326/2660] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:33 2022] PUT /identity/v3/projects/8e4902559dbd4f0d8ec8cff760af6808/users/3354254906d646ccbec320ec63d003b8/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:33.129998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1a731-0581-4af8-9ae8-3108b17f2b40 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.159808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1a731-0581-4af8-9ae8-3108b17f2b40 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.378890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77610dbe-4c32-4a90-9084-810a6f3ec450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.379850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77610dbe-4c32-4a90-9084-810a6f3ec450 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.380223 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77610dbe-4c32-4a90-9084-810a6f3ec450 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.380416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77610dbe-4c32-4a90-9084-810a6f3ec450 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.381505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77610dbe-4c32-4a90-9084-810a6f3ec450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.383757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77610dbe-4c32-4a90-9084-810a6f3ec450 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.422880 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1335/2661] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:33.424673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406f4de-02d1-455f-ae98-1f244e5250d5 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.442872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406f4de-02d1-455f-ae98-1f244e5250d5 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.459623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c41dc8-e7d9-4753-8c0b-10ae639c4a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.460700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c41dc8-e7d9-4753-8c0b-10ae639c4a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.461140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c41dc8-e7d9-4753-8c0b-10ae639c4a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.461629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c41dc8-e7d9-4753-8c0b-10ae639c4a30 admin admin] PATH_INFO: `/v3/projects/8e4902559dbd4f0d8ec8cff760af6808/users/3354254906d646ccbec320ec63d003b8/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.464092 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c41dc8-e7d9-4753-8c0b-10ae639c4a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4902559dbd4f0d8ec8cff760af6808, user_id=3354254906d646ccbec320ec63d003b8, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.468322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c41dc8-e7d9-4753-8c0b-10ae639c4a30 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.482271 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1327/2662] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:33 2022] PUT /identity/v3/projects/8e4902559dbd4f0d8ec8cff760af6808/users/3354254906d646ccbec320ec63d003b8/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:35.202118 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77610dbe-4c32-4a90-9084-810a6f3ec450 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.205092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-77610dbe-4c32-4a90-9084-810a6f3ec450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:35.251003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77610dbe-4c32-4a90-9084-810a6f3ec450 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.258929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:35.475249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.476165 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.477324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.478554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] PATH_INFO: `/v3/users/352a102f604048138df5a31bab4f8cc9` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.481496 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=352a102f604048138df5a31bab4f8cc9)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.486861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.642733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352a102f604048138df5a31bab4f8cc9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:35.647652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352a102f604048138df5a31bab4f8cc9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:35.682299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352a102f604048138df5a31bab4f8cc9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:35.698534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352a102f604048138df5a31bab4f8cc9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:35.699362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-b7f21ce0-38c5-462d-ad0a-75fb2c0e6b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352a102f604048138df5a31bab4f8cc9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:35.742678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1336/2663] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:35 2022] DELETE /identity/v3/users/352a102f604048138df5a31bab4f8cc9 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:36.147776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c41dc8-e7d9-4753-8c0b-10ae639c4a30 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:36.150522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-12c41dc8-e7d9-4753-8c0b-10ae639c4a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:36.183816 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c41dc8-e7d9-4753-8c0b-10ae639c4a30 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:36.197314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:36.320059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:36.320518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.320801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.321212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] PATH_INFO: `/v3/projects/58bac4a48cbf4e6d877b7617aa0f3c92` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.322629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58bac4a48cbf4e6d877b7617aa0f3c92)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:36.327898 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:36.387524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58bac4a48cbf4e6d877b7617aa0f3c92', 'request_id': 'req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.399733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58bac4a48cbf4e6d877b7617aa0f3c92', 'request_id': 'req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.415653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58bac4a48cbf4e6d877b7617aa0f3c92', 'request_id': 'req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.444070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] The token cache is being invalidate because project 58bac4a48cbf4e6d877b7617aa0f3c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:36.444449 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.445503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-28c011ea-311e-4c5f-b3ef-6287d8d0bc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.448109 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1328/2664] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:36 2022] DELETE /identity/v3/projects/58bac4a48cbf4e6d877b7617aa0f3c92 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:36.455084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8c2a1-5509-4e5c-ab99-1fafe22247e9 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.455703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8c2a1-5509-4e5c-ab99-1fafe22247e9 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.455703 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8c2a1-5509-4e5c-ab99-1fafe22247e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.492757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e8a8c2a1-5509-4e5c-ab99-1fafe22247e9 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:36.494411 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e8a8c2a1-5509-4e5c-ab99-1fafe22247e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:36.582047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1337/2665] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:36.596320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6998a-968f-4f71-aaa8-b9a3e50dbe14 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.596667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6998a-968f-4f71-aaa8-b9a3e50dbe14 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.596936 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6998a-968f-4f71-aaa8-b9a3e50dbe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.663513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f9e6998a-968f-4f71-aaa8-b9a3e50dbe14 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:36.664954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f9e6998a-968f-4f71-aaa8-b9a3e50dbe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:36.687473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1329/2666] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:36.692273 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8c2a1-5509-4e5c-ab99-1fafe22247e9 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:36.724132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8c2a1-5509-4e5c-ab99-1fafe22247e9 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:36.730608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367673d0-8fe9-4cd6-8d47-3fe7c57b0d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:36.731409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367673d0-8fe9-4cd6-8d47-3fe7c57b0d7c admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.731752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367673d0-8fe9-4cd6-8d47-3fe7c57b0d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.732095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367673d0-8fe9-4cd6-8d47-3fe7c57b0d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.733822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367673d0-8fe9-4cd6-8d47-3fe7c57b0d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:36.734211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367673d0-8fe9-4cd6-8d47-3fe7c57b0d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:36.739196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367673d0-8fe9-4cd6-8d47-3fe7c57b0d7c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:36.763542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1338/2667] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:36.768588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6998a-968f-4f71-aaa8-b9a3e50dbe14 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:36.797322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6998a-968f-4f71-aaa8-b9a3e50dbe14 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:36.807872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779cc45-aa70-4863-b24d-59e67751511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:36.808110 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779cc45-aa70-4863-b24d-59e67751511a admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.811331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779cc45-aa70-4863-b24d-59e67751511a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.811535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779cc45-aa70-4863-b24d-59e67751511a admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.812368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779cc45-aa70-4863-b24d-59e67751511a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:36.817862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779cc45-aa70-4863-b24d-59e67751511a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:36.869782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1330/2668] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:36.875329 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367673d0-8fe9-4cd6-8d47-3fe7c57b0d7c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:36.896707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367673d0-8fe9-4cd6-8d47-3fe7c57b0d7c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:36.939561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.086913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d247aab-c4fd-4d42-a981-f30b97c50cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.090003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d247aab-c4fd-4d42-a981-f30b97c50cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.090518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d247aab-c4fd-4d42-a981-f30b97c50cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.091235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d247aab-c4fd-4d42-a981-f30b97c50cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.095899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d247aab-c4fd-4d42-a981-f30b97c50cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.109967 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d247aab-c4fd-4d42-a981-f30b97c50cf7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.168006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1339/2669] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:37.171868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779cc45-aa70-4863-b24d-59e67751511a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.187644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779cc45-aa70-4863-b24d-59e67751511a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.194605 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc937c-f8f8-4920-b7b6-42b7308eb9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.195696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc937c-f8f8-4920-b7b6-42b7308eb9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.196255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc937c-f8f8-4920-b7b6-42b7308eb9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.196680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc937c-f8f8-4920-b7b6-42b7308eb9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.197499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc937c-f8f8-4920-b7b6-42b7308eb9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.199236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc937c-f8f8-4920-b7b6-42b7308eb9b9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.215118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1331/2670] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:37.221575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d247aab-c4fd-4d42-a981-f30b97c50cf7 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.241533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d247aab-c4fd-4d42-a981-f30b97c50cf7 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.259354 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bca88-f978-4b49-90f5-df6361ab059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.260231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bca88-f978-4b49-90f5-df6361ab059a admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.260653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bca88-f978-4b49-90f5-df6361ab059a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.261036 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bca88-f978-4b49-90f5-df6361ab059a admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.265104 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bca88-f978-4b49-90f5-df6361ab059a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.269508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bca88-f978-4b49-90f5-df6361ab059a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.288839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1340/2671] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:37.290053 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc937c-f8f8-4920-b7b6-42b7308eb9b9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.308770 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc937c-f8f8-4920-b7b6-42b7308eb9b9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.329867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba3d61-e867-4da1-b8c0-265330e121df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.331479 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba3d61-e867-4da1-b8c0-265330e121df admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.332175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba3d61-e867-4da1-b8c0-265330e121df admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.333371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba3d61-e867-4da1-b8c0-265330e121df admin admin] PATH_INFO: `/v3/projects/e13cb9cad9b24129b1b35bffb04b6738/users/49cbcbadffa64d41bff9ada77c5bff71/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.369006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba3d61-e867-4da1-b8c0-265330e121df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13cb9cad9b24129b1b35bffb04b6738, user_id=49cbcbadffa64d41bff9ada77c5bff71, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.376067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba3d61-e867-4da1-b8c0-265330e121df admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.403596 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1332/2672] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:37 2022] PUT /identity/v3/projects/e13cb9cad9b24129b1b35bffb04b6738/users/49cbcbadffa64d41bff9ada77c5bff71/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:37.415617 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c09d8-c34f-468e-a8ab-e8b8e7b4176c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.416059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c09d8-c34f-468e-a8ab-e8b8e7b4176c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.416347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c09d8-c34f-468e-a8ab-e8b8e7b4176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.472076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8a2c09d8-c34f-468e-a8ab-e8b8e7b4176c None None] MFA Rules not processed for user `49cbcbadffa64d41bff9ada77c5bff71`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:37.474042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8a2c09d8-c34f-468e-a8ab-e8b8e7b4176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:37.588029 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1341/2673] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:37.596138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba3d61-e867-4da1-b8c0-265330e121df admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.598158 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-08ba3d61-e867-4da1-b8c0-265330e121df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:37.650122 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.722056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba3d61-e867-4da1-b8c0-265330e121df admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.736186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2e8b-6798-49ca-ac92-3ef3f51b3946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.736879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2e8b-6798-49ca-ac92-3ef3f51b3946 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.737162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2e8b-6798-49ca-ac92-3ef3f51b3946 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.737438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2e8b-6798-49ca-ac92-3ef3f51b3946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.750139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2e8b-6798-49ca-ac92-3ef3f51b3946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.753500 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2e8b-6798-49ca-ac92-3ef3f51b3946 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.789010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1333/2674] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:38.103767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c09d8-c34f-468e-a8ab-e8b8e7b4176c None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.210804 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c09d8-c34f-468e-a8ab-e8b8e7b4176c None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.219230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.220230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.221039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.221568 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] PATH_INFO: `/v3/users/49cbcbadffa64d41bff9ada77c5bff71` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.223147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] RBAC: Authorizing `identity:delete_user(user_id=49cbcbadffa64d41bff9ada77c5bff71)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.225890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.262230 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.290098 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49cbcbadffa64d41bff9ada77c5bff71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:38.290602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49cbcbadffa64d41bff9ada77c5bff71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:38.313366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49cbcbadffa64d41bff9ada77c5bff71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:38.330547 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49cbcbadffa64d41bff9ada77c5bff71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:38.331435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49cbcbadffa64d41bff9ada77c5bff71'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:38.351378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1342/2675] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:38 2022] DELETE /identity/v3/users/49cbcbadffa64d41bff9ada77c5bff71 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:38.355887 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372713a-c417-45c3-87d5-af8e953acf8b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.357890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372713a-c417-45c3-87d5-af8e953acf8b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.358406 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372713a-c417-45c3-87d5-af8e953acf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.392417 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6372713a-c417-45c3-87d5-af8e953acf8b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:38.393667 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6372713a-c417-45c3-87d5-af8e953acf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:38.540569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1334/2676] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:38.548307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.549784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:38.663438 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890cc9-0b01-4631-a91a-e18aa27bd88b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.667641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10177e-fe34-4e42-a7c1-10227ce0c015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.668581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10177e-fe34-4e42-a7c1-10227ce0c015 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.669092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10177e-fe34-4e42-a7c1-10227ce0c015 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.669579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10177e-fe34-4e42-a7c1-10227ce0c015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.681807 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10177e-fe34-4e42-a7c1-10227ce0c015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.683490 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10177e-fe34-4e42-a7c1-10227ce0c015 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.697976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1343/2677] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:39.224778 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372713a-c417-45c3-87d5-af8e953acf8b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.226739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6372713a-c417-45c3-87d5-af8e953acf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:39.244240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372713a-c417-45c3-87d5-af8e953acf8b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.266755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.267515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.267991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.268267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] PATH_INFO: `/v3/projects/e13cb9cad9b24129b1b35bffb04b6738` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.280289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13cb9cad9b24129b1b35bffb04b6738)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.282535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.382635 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13cb9cad9b24129b1b35bffb04b6738', 'request_id': 'req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:39.395226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13cb9cad9b24129b1b35bffb04b6738', 'request_id': 'req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:39.409178 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13cb9cad9b24129b1b35bffb04b6738', 'request_id': 'req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:39.426913 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] The token cache is being invalidate because project e13cb9cad9b24129b1b35bffb04b6738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:39.427205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:39.431295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-63c25486-5d13-4e2f-8aaa-4f72b58ebe4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:39.433870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1335/2678] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:39 2022] DELETE /identity/v3/projects/e13cb9cad9b24129b1b35bffb04b6738 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:39.440108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fb01b-2ccc-4154-9195-8debfa92cfe6 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.440393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fb01b-2ccc-4154-9195-8debfa92cfe6 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.440671 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fb01b-2ccc-4154-9195-8debfa92cfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.483866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-680fb01b-2ccc-4154-9195-8debfa92cfe6 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:39.485373 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-680fb01b-2ccc-4154-9195-8debfa92cfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:39.637891 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1344/2679] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:39.647144 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150acad-3e8e-41f5-a726-52019fef8065 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.647513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150acad-3e8e-41f5-a726-52019fef8065 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.647854 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150acad-3e8e-41f5-a726-52019fef8065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.686099 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3150acad-3e8e-41f5-a726-52019fef8065 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:39.688624 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3150acad-3e8e-41f5-a726-52019fef8065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:39.698227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1336/2680] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:39.703477 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fb01b-2ccc-4154-9195-8debfa92cfe6 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.717952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fb01b-2ccc-4154-9195-8debfa92cfe6 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.731487 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c82bed-1bc3-4fca-94a6-bca041829512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.733374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c82bed-1bc3-4fca-94a6-bca041829512 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.733828 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c82bed-1bc3-4fca-94a6-bca041829512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.734285 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c82bed-1bc3-4fca-94a6-bca041829512 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.735053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c82bed-1bc3-4fca-94a6-bca041829512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:39.735360 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c82bed-1bc3-4fca-94a6-bca041829512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.736986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c82bed-1bc3-4fca-94a6-bca041829512 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.765347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1345/2681] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:39.771085 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150acad-3e8e-41f5-a726-52019fef8065 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.786581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150acad-3e8e-41f5-a726-52019fef8065 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.803114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d6927-062a-419f-9e1b-69599f727192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.803953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d6927-062a-419f-9e1b-69599f727192 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.804317 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d6927-062a-419f-9e1b-69599f727192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.804685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d6927-062a-419f-9e1b-69599f727192 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.805507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d6927-062a-419f-9e1b-69599f727192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.807776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d6927-062a-419f-9e1b-69599f727192 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.886650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1337/2682] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:39 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:39.886927 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c82bed-1bc3-4fca-94a6-bca041829512 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.900539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c82bed-1bc3-4fca-94a6-bca041829512 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.985123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.087630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433bd18-9192-49af-8384-bec9ff83639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.089384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433bd18-9192-49af-8384-bec9ff83639a admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.089837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433bd18-9192-49af-8384-bec9ff83639a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.090446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433bd18-9192-49af-8384-bec9ff83639a admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.092268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433bd18-9192-49af-8384-bec9ff83639a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.095147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433bd18-9192-49af-8384-bec9ff83639a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.137106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1346/2683] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:39 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:40.141877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d6927-062a-419f-9e1b-69599f727192 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.157855 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d6927-062a-419f-9e1b-69599f727192 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.163437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece49739-a548-42d3-b860-6752153e1814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.164430 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece49739-a548-42d3-b860-6752153e1814 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.164922 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece49739-a548-42d3-b860-6752153e1814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.165366 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece49739-a548-42d3-b860-6752153e1814 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.166186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece49739-a548-42d3-b860-6752153e1814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.172356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece49739-a548-42d3-b860-6752153e1814 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.207781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433bd18-9192-49af-8384-bec9ff83639a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.211534 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1338/2684] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:40.225819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433bd18-9192-49af-8384-bec9ff83639a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.234400 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9b41e-16af-4669-b0bd-6c94a6d1e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.235269 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9b41e-16af-4669-b0bd-6c94a6d1e6da admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.235710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9b41e-16af-4669-b0bd-6c94a6d1e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.236172 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9b41e-16af-4669-b0bd-6c94a6d1e6da admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.236871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9b41e-16af-4669-b0bd-6c94a6d1e6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.238502 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9b41e-16af-4669-b0bd-6c94a6d1e6da admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.278288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece49739-a548-42d3-b860-6752153e1814 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.284795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1347/2685] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:40.290498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.295983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece49739-a548-42d3-b860-6752153e1814 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.311022 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18fe2-cb39-47ee-879f-66d012e18a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.311958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18fe2-cb39-47ee-879f-66d012e18a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.313261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18fe2-cb39-47ee-879f-66d012e18a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.313758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18fe2-cb39-47ee-879f-66d012e18a79 admin admin] PATH_INFO: `/v3/projects/5182c6807c1b471984d9d8da4147adbb/users/1e59f1ef2dec4415af625f91f3083dbd/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.340205 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc18fe2-cb39-47ee-879f-66d012e18a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5182c6807c1b471984d9d8da4147adbb, user_id=1e59f1ef2dec4415af625f91f3083dbd, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.343957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc18fe2-cb39-47ee-879f-66d012e18a79 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.364195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1339/2686] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:40 2022] PUT /identity/v3/projects/5182c6807c1b471984d9d8da4147adbb/users/1e59f1ef2dec4415af625f91f3083dbd/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:40.377336 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0be0-70cf-439c-8dc9-532127e0672f None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.377683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0be0-70cf-439c-8dc9-532127e0672f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.377968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0be0-70cf-439c-8dc9-532127e0672f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.430581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f3db0be0-70cf-439c-8dc9-532127e0672f None None] MFA Rules not processed for user `1e59f1ef2dec4415af625f91f3083dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:40.439513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f3db0be0-70cf-439c-8dc9-532127e0672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:40.584667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1348/2687] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:40.593015 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18fe2-cb39-47ee-879f-66d012e18a79 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.696729 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18fe2-cb39-47ee-879f-66d012e18a79 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.702029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd47855-5cfd-4994-8d26-8fd45c595cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.702831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47855-5cfd-4994-8d26-8fd45c595cdc admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.703112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47855-5cfd-4994-8d26-8fd45c595cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.703387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47855-5cfd-4994-8d26-8fd45c595cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.704957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd47855-5cfd-4994-8d26-8fd45c595cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.707267 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd47855-5cfd-4994-8d26-8fd45c595cdc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.749499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1340/2688] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:40 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:40.755109 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0be0-70cf-439c-8dc9-532127e0672f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.775030 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0be0-70cf-439c-8dc9-532127e0672f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.862009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2483aa-7de9-44b9-80f8-af4b894f3a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.862567 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2483aa-7de9-44b9-80f8-af4b894f3a90 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.869186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2483aa-7de9-44b9-80f8-af4b894f3a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.871919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2483aa-7de9-44b9-80f8-af4b894f3a90 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.871919 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2483aa-7de9-44b9-80f8-af4b894f3a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.872929 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2483aa-7de9-44b9-80f8-af4b894f3a90 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.935248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1349/2689] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:40 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:40.939787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd47855-5cfd-4994-8d26-8fd45c595cdc admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.952831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd47855-5cfd-4994-8d26-8fd45c595cdc admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.967190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497620f0-3c2b-445f-80ce-3c43a44a55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.967840 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497620f0-3c2b-445f-80ce-3c43a44a55f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.968121 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497620f0-3c2b-445f-80ce-3c43a44a55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.968396 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497620f0-3c2b-445f-80ce-3c43a44a55f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.969451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497620f0-3c2b-445f-80ce-3c43a44a55f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.971418 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497620f0-3c2b-445f-80ce-3c43a44a55f4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.990120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1341/2690] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:40.991386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2483aa-7de9-44b9-80f8-af4b894f3a90 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.009907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2483aa-7de9-44b9-80f8-af4b894f3a90 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.015433 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f529da-8685-4ae3-aba2-6fabaa24ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.016123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f529da-8685-4ae3-aba2-6fabaa24ec86 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.016718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f529da-8685-4ae3-aba2-6fabaa24ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.016998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f529da-8685-4ae3-aba2-6fabaa24ec86 admin admin] PATH_INFO: `/v3/projects/f061bfdfb6044892acf4a98e3e16a46a/users/1742015e9f4d49d29e81c7b40557d334/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.067034 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f529da-8685-4ae3-aba2-6fabaa24ec86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f061bfdfb6044892acf4a98e3e16a46a, user_id=1742015e9f4d49d29e81c7b40557d334, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.069811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f529da-8685-4ae3-aba2-6fabaa24ec86 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.111296 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1350/2691] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:40 2022] PUT /identity/v3/projects/f061bfdfb6044892acf4a98e3e16a46a/users/1742015e9f4d49d29e81c7b40557d334/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:41.115321 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497620f0-3c2b-445f-80ce-3c43a44a55f4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.130529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497620f0-3c2b-445f-80ce-3c43a44a55f4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.240161 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb425fed-264d-4253-a88b-147531e59323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.241169 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425fed-264d-4253-a88b-147531e59323 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.241367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425fed-264d-4253-a88b-147531e59323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.241826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425fed-264d-4253-a88b-147531e59323 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.242626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb425fed-264d-4253-a88b-147531e59323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.244782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb425fed-264d-4253-a88b-147531e59323 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.261497 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1342/2692] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:41.262713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f529da-8685-4ae3-aba2-6fabaa24ec86 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.275379 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f529da-8685-4ae3-aba2-6fabaa24ec86 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.282441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f5f77-78f5-4a83-bb7f-d5699fbdeeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.283224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f5f77-78f5-4a83-bb7f-d5699fbdeeef admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.283503 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f5f77-78f5-4a83-bb7f-d5699fbdeeef admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.283777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f5f77-78f5-4a83-bb7f-d5699fbdeeef admin admin] PATH_INFO: `/v3/projects/f061bfdfb6044892acf4a98e3e16a46a/users/1742015e9f4d49d29e81c7b40557d334/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.285785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f5f77-78f5-4a83-bb7f-d5699fbdeeef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f061bfdfb6044892acf4a98e3e16a46a, user_id=1742015e9f4d49d29e81c7b40557d334, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.289912 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f5f77-78f5-4a83-bb7f-d5699fbdeeef admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.293504 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.318501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8302ca9-7834-45aa-9cb3-5a11329d293d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.318978 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8302ca9-7834-45aa-9cb3-5a11329d293d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.319260 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8302ca9-7834-45aa-9cb3-5a11329d293d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.321505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1351/2693] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:41 2022] PUT /identity/v3/projects/f061bfdfb6044892acf4a98e3e16a46a/users/1742015e9f4d49d29e81c7b40557d334/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:41.323035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43939d89-c771-42ea-8c78-c800f5fe05e7 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.323946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43939d89-c771-42ea-8c78-c800f5fe05e7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.323946 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43939d89-c771-42ea-8c78-c800f5fe05e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.364356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c8302ca9-7834-45aa-9cb3-5a11329d293d None None] MFA Rules not processed for user `3354254906d646ccbec320ec63d003b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:41.365621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c8302ca9-7834-45aa-9cb3-5a11329d293d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.367972 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-43939d89-c771-42ea-8c78-c800f5fe05e7 None None] MFA Rules not processed for user `1742015e9f4d49d29e81c7b40557d334`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:41.369446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-43939d89-c771-42ea-8c78-c800f5fe05e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.417608 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.455580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1343/2694] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:41.468132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8302ca9-7834-45aa-9cb3-5a11329d293d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.469961 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c8302ca9-7834-45aa-9cb3-5a11329d293d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.489103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1352/2695] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:41.501374 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43939d89-c771-42ea-8c78-c800f5fe05e7 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.503069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-43939d89-c771-42ea-8c78-c800f5fe05e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.565032 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8302ca9-7834-45aa-9cb3-5a11329d293d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.569444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbf290-00db-4e68-a75c-a003218870f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d4e9baa7a6241b1807c67844c7d424c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.570075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbf290-00db-4e68-a75c-a003218870f4 service glance] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.570354 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbf290-00db-4e68-a75c-a003218870f4 service glance] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.570802 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbf290-00db-4e68-a75c-a003218870f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.572799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f7dbf290-00db-4e68-a75c-a003218870f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.574850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43939d89-c771-42ea-8c78-c800f5fe05e7 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.581342 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf6636-b81b-423c-9a9b-3fb6c19b1f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.582681 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf6636-b81b-423c-9a9b-3fb6c19b1f3a service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.583161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf6636-b81b-423c-9a9b-3fb6c19b1f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.583606 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf6636-b81b-423c-9a9b-3fb6c19b1f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.599176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf6636-b81b-423c-9a9b-3fb6c19b1f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.600700 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf6636-b81b-423c-9a9b-3fb6c19b1f3a service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.611658 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1353/2696] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:41.659591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbf290-00db-4e68-a75c-a003218870f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.661332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbf290-00db-4e68-a75c-a003218870f4 service glance] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.674575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1344/2697] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:41.685144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf6636-b81b-423c-9a9b-3fb6c19b1f3a service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.773863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf6636-b81b-423c-9a9b-3fb6c19b1f3a service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.781081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.781678 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.781951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.782544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] PATH_INFO: `/v3/users/1e59f1ef2dec4415af625f91f3083dbd` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.783772 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e59f1ef2dec4415af625f91f3083dbd)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.785756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.828920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.853589 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff17e3-6803-41ef-a1c1-8634d2d815ed None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.854232 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff17e3-6803-41ef-a1c1-8634d2d815ed None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.854923 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff17e3-6803-41ef-a1c1-8634d2d815ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.884544 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fdff17e3-6803-41ef-a1c1-8634d2d815ed None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:41.886657 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fdff17e3-6803-41ef-a1c1-8634d2d815ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.892664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e59f1ef2dec4415af625f91f3083dbd'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:41.893469 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e59f1ef2dec4415af625f91f3083dbd'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:41.929358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e59f1ef2dec4415af625f91f3083dbd'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:41.941367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e59f1ef2dec4415af625f91f3083dbd'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:41.942335 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ce76349b-cec8-4305-aabc-31e2a5158f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e59f1ef2dec4415af625f91f3083dbd'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:41.962850 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1354/2698] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:41 2022] DELETE /identity/v3/users/1e59f1ef2dec4415af625f91f3083dbd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:41.967056 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df3aa-67ff-4a47-ae47-5c6c0fe95231 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.967453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df3aa-67ff-4a47-ae47-5c6c0fe95231 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.967932 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df3aa-67ff-4a47-ae47-5c6c0fe95231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.977989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1345/2699] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:42.005262 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-b60df3aa-67ff-4a47-ae47-5c6c0fe95231 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:42.005451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff17e3-6803-41ef-a1c1-8634d2d815ed None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.006900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b60df3aa-67ff-4a47-ae47-5c6c0fe95231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:42.007726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fdff17e3-6803-41ef-a1c1-8634d2d815ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:42.094350 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1355/2700] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:42.100621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.115873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df3aa-67ff-4a47-ae47-5c6c0fe95231 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.118625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-b60df3aa-67ff-4a47-ae47-5c6c0fe95231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:42.144979 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff17e3-6803-41ef-a1c1-8634d2d815ed None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.204653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df3aa-67ff-4a47-ae47-5c6c0fe95231 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.211903 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc8e68-d191-4f30-bbab-822f73bad1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.212532 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc8e68-d191-4f30-bbab-822f73bad1df service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.212818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc8e68-d191-4f30-bbab-822f73bad1df service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.213124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc8e68-d191-4f30-bbab-822f73bad1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.230902 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc8e68-d191-4f30-bbab-822f73bad1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.234020 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc8e68-d191-4f30-bbab-822f73bad1df service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.247032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1356/2701] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:42.256478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa255a-9581-42f0-831e-e4bf1c0c34f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.257456 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa255a-9581-42f0-831e-e4bf1c0c34f5 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.258049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa255a-9581-42f0-831e-e4bf1c0c34f5 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.258498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa255a-9581-42f0-831e-e4bf1c0c34f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.344720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa255a-9581-42f0-831e-e4bf1c0c34f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.346277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa255a-9581-42f0-831e-e4bf1c0c34f5 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.357558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1346/2702] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:53:42.683043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc8e68-d191-4f30-bbab-822f73bad1df service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.686153 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6cdc8e68-d191-4f30-bbab-822f73bad1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:42.710197 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc8e68-d191-4f30-bbab-822f73bad1df service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.722995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.726398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.726398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.726755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] PATH_INFO: `/v3/projects/5182c6807c1b471984d9d8da4147adbb` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.728204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5182c6807c1b471984d9d8da4147adbb)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.731573 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.824343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.850184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5182c6807c1b471984d9d8da4147adbb', 'request_id': 'req-8e06bb45-fb9d-4c0c-808b-5f8731375751'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.872069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5182c6807c1b471984d9d8da4147adbb', 'request_id': 'req-8e06bb45-fb9d-4c0c-808b-5f8731375751'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.894101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5182c6807c1b471984d9d8da4147adbb', 'request_id': 'req-8e06bb45-fb9d-4c0c-808b-5f8731375751'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.912922 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] The token cache is being invalidate because project 5182c6807c1b471984d9d8da4147adbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:42.913290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.914147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8e06bb45-fb9d-4c0c-808b-5f8731375751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.921719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1357/2703] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:42 2022] DELETE /identity/v3/projects/5182c6807c1b471984d9d8da4147adbb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:42.923039 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa255a-9581-42f0-831e-e4bf1c0c34f5 service swift] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.955616 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa255a-9581-42f0-831e-e4bf1c0c34f5 service swift] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.130318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.134297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.134869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.135375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] PATH_INFO: `/v3/users/1742015e9f4d49d29e81c7b40557d334` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.139619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1742015e9f4d49d29e81c7b40557d334)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.144644 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.192776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.237012 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1742015e9f4d49d29e81c7b40557d334'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.250353 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1742015e9f4d49d29e81c7b40557d334'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.268344 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1742015e9f4d49d29e81c7b40557d334'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.289973 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1742015e9f4d49d29e81c7b40557d334'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.290879 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1742015e9f4d49d29e81c7b40557d334'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.302821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1347/2704] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:42 2022] DELETE /identity/v3/users/1742015e9f4d49d29e81c7b40557d334 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:43.672592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfbd1-2a60-429a-bade-c615644136ca None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.672882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfbd1-2a60-429a-bade-c615644136ca None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.673156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfbd1-2a60-429a-bade-c615644136ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.704008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-db9cfbd1-2a60-429a-bade-c615644136ca None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:43.706222 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-db9cfbd1-2a60-429a-bade-c615644136ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:43.799478 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1358/2705] 10.222.0.65 () {58 vars in 967 bytes} [Thu Aug 18 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:43.816782 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.818521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:43.852816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cfbd1-2a60-429a-bade-c615644136ca None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.855306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-db9cfbd1-2a60-429a-bade-c615644136ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:43.967897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfca458-9ca9-40c7-8293-2fc81223e2d9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.974347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11375c-567f-437d-9bf7-276b82a5f46f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.975006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11375c-567f-437d-9bf7-276b82a5f46f service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.975288 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11375c-567f-437d-9bf7-276b82a5f46f service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.975565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11375c-567f-437d-9bf7-276b82a5f46f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.988707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11375c-567f-437d-9bf7-276b82a5f46f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.990617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11375c-567f-437d-9bf7-276b82a5f46f service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.995392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cfbd1-2a60-429a-bade-c615644136ca None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.000778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.001666 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.001874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1348/2706] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:53:44.002337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.002611 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] PATH_INFO: `/v3/projects/f061bfdfb6044892acf4a98e3e16a46a` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.004446 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f061bfdfb6044892acf4a98e3e16a46a)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.006841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.075475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f061bfdfb6044892acf4a98e3e16a46a', 'request_id': 'req-11614c68-3bf0-4d39-b04f-7f44183458f1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:44.083833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f061bfdfb6044892acf4a98e3e16a46a', 'request_id': 'req-11614c68-3bf0-4d39-b04f-7f44183458f1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:44.099760 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f061bfdfb6044892acf4a98e3e16a46a', 'request_id': 'req-11614c68-3bf0-4d39-b04f-7f44183458f1'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:44.124013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] The token cache is being invalidate because project f061bfdfb6044892acf4a98e3e16a46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:44.124305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:44.125050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-11614c68-3bf0-4d39-b04f-7f44183458f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:44.129694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1359/2707] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:43 2022] DELETE /identity/v3/projects/f061bfdfb6044892acf4a98e3e16a46a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:44.134622 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181ecde-9eb7-4b75-8a8e-abb4afe79e05 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.134930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181ecde-9eb7-4b75-8a8e-abb4afe79e05 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.135199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181ecde-9eb7-4b75-8a8e-abb4afe79e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.184468 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2181ecde-9eb7-4b75-8a8e-abb4afe79e05 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:44.188508 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2181ecde-9eb7-4b75-8a8e-abb4afe79e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:44.319063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1349/2708] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:44.327885 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43305e47-6b7e-4584-a288-a141d43b2add None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.328183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43305e47-6b7e-4584-a288-a141d43b2add None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.328459 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43305e47-6b7e-4584-a288-a141d43b2add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.337184 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:44.351575 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-43305e47-6b7e-4584-a288-a141d43b2add None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:44.355211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-43305e47-6b7e-4584-a288-a141d43b2add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:44.371008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1360/2709] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:44.373846 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181ecde-9eb7-4b75-8a8e-abb4afe79e05 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.386868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181ecde-9eb7-4b75-8a8e-abb4afe79e05 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.400851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1796e6-19ba-48c1-8707-b8b839d0b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.401762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1796e6-19ba-48c1-8707-b8b839d0b686 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.402115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1796e6-19ba-48c1-8707-b8b839d0b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.402388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1796e6-19ba-48c1-8707-b8b839d0b686 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.403129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1796e6-19ba-48c1-8707-b8b839d0b686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:44.403487 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1796e6-19ba-48c1-8707-b8b839d0b686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.406543 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1796e6-19ba-48c1-8707-b8b839d0b686 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.421095 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1350/2710] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:44.425182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43305e47-6b7e-4584-a288-a141d43b2add None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.442756 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43305e47-6b7e-4584-a288-a141d43b2add None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.449297 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aadf05-2edb-4b91-89d0-b788778cece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.450947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aadf05-2edb-4b91-89d0-b788778cece4 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.451566 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aadf05-2edb-4b91-89d0-b788778cece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.452128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aadf05-2edb-4b91-89d0-b788778cece4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.453205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aadf05-2edb-4b91-89d0-b788778cece4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.459465 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aadf05-2edb-4b91-89d0-b788778cece4 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.520861 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1361/2711] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:44 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:44.525292 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1796e6-19ba-48c1-8707-b8b839d0b686 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.558818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1796e6-19ba-48c1-8707-b8b839d0b686 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.672588 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:44.806707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419051-0ef2-46fe-a8d2-97d9315510ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.807770 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419051-0ef2-46fe-a8d2-97d9315510ac admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.807944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419051-0ef2-46fe-a8d2-97d9315510ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.808319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419051-0ef2-46fe-a8d2-97d9315510ac admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.809102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26419051-0ef2-46fe-a8d2-97d9315510ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.811766 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26419051-0ef2-46fe-a8d2-97d9315510ac admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.856563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1351/2712] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:44 2022] POST /identity/v3/users => generated 291 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:44.857856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aadf05-2edb-4b91-89d0-b788778cece4 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.910893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aadf05-2edb-4b91-89d0-b788778cece4 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.947748 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d674e2b-cc41-44aa-b907-e1a339b0d7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.948391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674e2b-cc41-44aa-b907-e1a339b0d7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.948672 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674e2b-cc41-44aa-b907-e1a339b0d7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.948945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674e2b-cc41-44aa-b907-e1a339b0d7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.949608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d674e2b-cc41-44aa-b907-e1a339b0d7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.952246 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d674e2b-cc41-44aa-b907-e1a339b0d7e6 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.994095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1362/2713] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:44.995213 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419051-0ef2-46fe-a8d2-97d9315510ac admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.014640 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419051-0ef2-46fe-a8d2-97d9315510ac admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.027561 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d495d3-0e2d-46fe-9a2a-4d556ef6e9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.028193 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d495d3-0e2d-46fe-9a2a-4d556ef6e9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.028463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d495d3-0e2d-46fe-9a2a-4d556ef6e9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.029333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d495d3-0e2d-46fe-9a2a-4d556ef6e9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.035555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d495d3-0e2d-46fe-9a2a-4d556ef6e9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:45.043480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d495d3-0e2d-46fe-9a2a-4d556ef6e9a4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:45.096113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1352/2714] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:45.103210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d674e2b-cc41-44aa-b907-e1a339b0d7e6 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.119581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d674e2b-cc41-44aa-b907-e1a339b0d7e6 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.124895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7f362-3725-4dcb-9bad-8051f22aa768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.125581 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7f362-3725-4dcb-9bad-8051f22aa768 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.125863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7f362-3725-4dcb-9bad-8051f22aa768 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.126140 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7f362-3725-4dcb-9bad-8051f22aa768 admin admin] PATH_INFO: `/v3/projects/cf3a864b8aae42759cc3c276b352ce9c/users/fa9c7ad4ced9485fa72c4c7e255cde6a/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.166013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7f362-3725-4dcb-9bad-8051f22aa768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3a864b8aae42759cc3c276b352ce9c, user_id=fa9c7ad4ced9485fa72c4c7e255cde6a, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:45.173319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7f362-3725-4dcb-9bad-8051f22aa768 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:45.207572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1363/2715] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:45 2022] PUT /identity/v3/projects/cf3a864b8aae42759cc3c276b352ce9c/users/fa9c7ad4ced9485fa72c4c7e255cde6a/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:45.208993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ffc2e-849e-4b5a-9a99-097c52777225 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.208993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ffc2e-849e-4b5a-9a99-097c52777225 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.208993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ffc2e-849e-4b5a-9a99-097c52777225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.259764 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-927ffc2e-849e-4b5a-9a99-097c52777225 None None] MFA Rules not processed for user `fa9c7ad4ced9485fa72c4c7e255cde6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:45.263278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-927ffc2e-849e-4b5a-9a99-097c52777225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:45.386426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1353/2716] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:45.387843 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7f362-3725-4dcb-9bad-8051f22aa768 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.524071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7f362-3725-4dcb-9bad-8051f22aa768 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.542838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25057610-68dd-49b0-bcdd-5e1cb1585671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.543632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25057610-68dd-49b0-bcdd-5e1cb1585671 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.543955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25057610-68dd-49b0-bcdd-5e1cb1585671 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.544229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25057610-68dd-49b0-bcdd-5e1cb1585671 admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.545427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25057610-68dd-49b0-bcdd-5e1cb1585671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:45.547526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25057610-68dd-49b0-bcdd-5e1cb1585671 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:45.608717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1364/2717] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:45 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:45.612512 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ffc2e-849e-4b5a-9a99-097c52777225 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.632575 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ffc2e-849e-4b5a-9a99-097c52777225 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.746179 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1853e9-b309-41e9-ab2b-78684bcfe26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.747059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1853e9-b309-41e9-ab2b-78684bcfe26b admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.747059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1853e9-b309-41e9-ab2b-78684bcfe26b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.747429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1853e9-b309-41e9-ab2b-78684bcfe26b admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.748721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1853e9-b309-41e9-ab2b-78684bcfe26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:45.751217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1853e9-b309-41e9-ab2b-78684bcfe26b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:45.784733 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1354/2718] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:45 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:45.788622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25057610-68dd-49b0-bcdd-5e1cb1585671 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.807554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25057610-68dd-49b0-bcdd-5e1cb1585671 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.813180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f2bbc-ce4f-4e8a-b168-b4e92c2d225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.813815 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2bbc-ce4f-4e8a-b168-b4e92c2d225b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.814095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2bbc-ce4f-4e8a-b168-b4e92c2d225b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.814372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2bbc-ce4f-4e8a-b168-b4e92c2d225b admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.815394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f2bbc-ce4f-4e8a-b168-b4e92c2d225b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:45.817766 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f2bbc-ce4f-4e8a-b168-b4e92c2d225b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:45.857469 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1365/2719] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:45.858132 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1853e9-b309-41e9-ab2b-78684bcfe26b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.871431 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1853e9-b309-41e9-ab2b-78684bcfe26b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.878741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf38357-ff5b-4338-844c-b24f561a9bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.879896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf38357-ff5b-4338-844c-b24f561a9bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.879896 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf38357-ff5b-4338-844c-b24f561a9bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.880116 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf38357-ff5b-4338-844c-b24f561a9bfa admin admin] PATH_INFO: `/v3/projects/58c06c5dcd344e9f9e33c768f02f4c0e/users/04f7c8cf80ed4c0085d8db7ebf411fa9/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.899595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:45.911880 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf38357-ff5b-4338-844c-b24f561a9bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c06c5dcd344e9f9e33c768f02f4c0e, user_id=04f7c8cf80ed4c0085d8db7ebf411fa9, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:45.914906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf38357-ff5b-4338-844c-b24f561a9bfa admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:45.936780 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1355/2720] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:45 2022] PUT /identity/v3/projects/58c06c5dcd344e9f9e33c768f02f4c0e/users/04f7c8cf80ed4c0085d8db7ebf411fa9/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:45.941582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f2bbc-ce4f-4e8a-b168-b4e92c2d225b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.956357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f2bbc-ce4f-4e8a-b168-b4e92c2d225b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.083730 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6ad56-d048-46df-940a-7097fa6a0759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.084468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6ad56-d048-46df-940a-7097fa6a0759 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.084817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6ad56-d048-46df-940a-7097fa6a0759 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.085156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6ad56-d048-46df-940a-7097fa6a0759 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.085872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6ad56-d048-46df-940a-7097fa6a0759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.087512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6ad56-d048-46df-940a-7097fa6a0759 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.109396 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1366/2721] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:46.113579 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf38357-ff5b-4338-844c-b24f561a9bfa admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.134646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf38357-ff5b-4338-844c-b24f561a9bfa admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.141211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487a6fa-972d-4c41-be52-5b6c1c55fc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.141899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487a6fa-972d-4c41-be52-5b6c1c55fc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.142184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487a6fa-972d-4c41-be52-5b6c1c55fc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.142464 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487a6fa-972d-4c41-be52-5b6c1c55fc5b admin admin] PATH_INFO: `/v3/projects/58c06c5dcd344e9f9e33c768f02f4c0e/users/04f7c8cf80ed4c0085d8db7ebf411fa9/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.144737 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487a6fa-972d-4c41-be52-5b6c1c55fc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c06c5dcd344e9f9e33c768f02f4c0e, user_id=04f7c8cf80ed4c0085d8db7ebf411fa9, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.147643 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487a6fa-972d-4c41-be52-5b6c1c55fc5b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.166558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1356/2722] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:46 2022] PUT /identity/v3/projects/58c06c5dcd344e9f9e33c768f02f4c0e/users/04f7c8cf80ed4c0085d8db7ebf411fa9/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:46.177039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e320f-28b7-4662-b014-a7b5d81a66e1 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.177579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e320f-28b7-4662-b014-a7b5d81a66e1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.177952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e320f-28b7-4662-b014-a7b5d81a66e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.206141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.235714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-8f0e320f-28b7-4662-b014-a7b5d81a66e1 None None] MFA Rules not processed for user `04f7c8cf80ed4c0085d8db7ebf411fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:46.237130 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8f0e320f-28b7-4662-b014-a7b5d81a66e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.340357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1367/2723] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:46.353739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487a6fa-972d-4c41-be52-5b6c1c55fc5b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.355785 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0487a6fa-972d-4c41-be52-5b6c1c55fc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.438693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487a6fa-972d-4c41-be52-5b6c1c55fc5b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.442450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1961f87-41a0-41b8-9028-56166886fecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.443114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1961f87-41a0-41b8-9028-56166886fecc service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.443392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1961f87-41a0-41b8-9028-56166886fecc service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.443666 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1961f87-41a0-41b8-9028-56166886fecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.454687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1961f87-41a0-41b8-9028-56166886fecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.456325 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1961f87-41a0-41b8-9028-56166886fecc service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.467401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1357/2724] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:46.874554 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e320f-28b7-4662-b014-a7b5d81a66e1 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.884555 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e320f-28b7-4662-b014-a7b5d81a66e1 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.894351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6cf8e-6376-49c7-aea1-2621f4a2f23e tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f7c8cf80ed4c0085d8db7ebf411fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58c06c5dcd344e9f9e33c768f02f4c0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.895278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6cf8e-6376-49c7-aea1-2621f4a2f23e tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.896289 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6cf8e-6376-49c7-aea1-2621f4a2f23e tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.896640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6cf8e-6376-49c7-aea1-2621f4a2f23e tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.897441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6cf8e-6376-49c7-aea1-2621f4a2f23e tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:46.897808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6cf8e-6376-49c7-aea1-2621f4a2f23e tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.899733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6cf8e-6376-49c7-aea1-2621f4a2f23e tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.917795 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1368/2725] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:46.922313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1961f87-41a0-41b8-9028-56166886fecc service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.933967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1961f87-41a0-41b8-9028-56166886fecc service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.945742 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a439-8073-4784-9eb2-62d1ff3e9244 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f7c8cf80ed4c0085d8db7ebf411fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58c06c5dcd344e9f9e33c768f02f4c0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.946467 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a439-8073-4784-9eb2-62d1ff3e9244 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.946882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a439-8073-4784-9eb2-62d1ff3e9244 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.947227 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a439-8073-4784-9eb2-62d1ff3e9244 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.947994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a439-8073-4784-9eb2-62d1ff3e9244 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.950047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a439-8073-4784-9eb2-62d1ff3e9244 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.995758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1358/2726] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/projects => generated 354 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:46.996626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6cf8e-6376-49c7-aea1-2621f4a2f23e tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.010182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6cf8e-6376-49c7-aea1-2621f4a2f23e tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.091646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f7c8cf80ed4c0085d8db7ebf411fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58c06c5dcd344e9f9e33c768f02f4c0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.092288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.092564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.092837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.093497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.093948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.095593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.109519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1369/2727] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.155815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a439-8073-4784-9eb2-62d1ff3e9244 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.167741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a439-8073-4784-9eb2-62d1ff3e9244 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.177886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f7c8cf80ed4c0085d8db7ebf411fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58c06c5dcd344e9f9e33c768f02f4c0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.178554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.178890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.179167 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] PATH_INFO: `/v3/projects/f59f4d353a8c4779b3720040a98e3d03` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.183571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f59f4d353a8c4779b3720040a98e3d03)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.186724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.248029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59f4d353a8c4779b3720040a98e3d03', 'request_id': 'req-50f4ddc5-d864-4c80-94f9-5dea312eebb4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.258339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59f4d353a8c4779b3720040a98e3d03', 'request_id': 'req-50f4ddc5-d864-4c80-94f9-5dea312eebb4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.267769 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59f4d353a8c4779b3720040a98e3d03', 'request_id': 'req-50f4ddc5-d864-4c80-94f9-5dea312eebb4'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.283507 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] The token cache is being invalidate because project f59f4d353a8c4779b3720040a98e3d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:47.284128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.285137 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-50f4ddc5-d864-4c80-94f9-5dea312eebb4 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.286969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1359/2728] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:47 2022] DELETE /identity/v3/projects/f59f4d353a8c4779b3720040a98e3d03 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:47.523135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.523328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.605219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed872d-85fd-4bd5-9469-9317bdc6be28 tempest-VolumeQuotaClassesTest-1864580954 tempest-VolumeQuotaClassesTest-1864580954-project-admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.629368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.678948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.679585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.679925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.680218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] PATH_INFO: `/v3/users/fa9c7ad4ced9485fa72c4c7e255cde6a` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.681325 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa9c7ad4ced9485fa72c4c7e255cde6a)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.683276 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.741491 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa9c7ad4ced9485fa72c4c7e255cde6a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.742144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa9c7ad4ced9485fa72c4c7e255cde6a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.761910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa9c7ad4ced9485fa72c4c7e255cde6a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.771470 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa9c7ad4ced9485fa72c4c7e255cde6a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.772206 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa9c7ad4ced9485fa72c4c7e255cde6a'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.786939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1370/2729] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:47 2022] DELETE /identity/v3/users/fa9c7ad4ced9485fa72c4c7e255cde6a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:47.791272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31610f-674d-4920-afce-721ccbc4a4ae None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.791787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31610f-674d-4920-afce-721ccbc4a4ae None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.792272 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31610f-674d-4920-afce-721ccbc4a4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.815799 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1d31610f-674d-4920-afce-721ccbc4a4ae None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:47.817295 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1d31610f-674d-4920-afce-721ccbc4a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.865079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.900115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1360/2730] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:47.911709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.913268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.988074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910fa4-db8b-41ff-87c4-0d217695c200 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.992302 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18e072-1267-4405-831d-14b9a655945f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.993142 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18e072-1267-4405-831d-14b9a655945f service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.993590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18e072-1267-4405-831d-14b9a655945f service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.994037 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18e072-1267-4405-831d-14b9a655945f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.006686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18e072-1267-4405-831d-14b9a655945f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.008158 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18e072-1267-4405-831d-14b9a655945f service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.020719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1371/2731] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:48.364191 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31610f-674d-4920-afce-721ccbc4a4ae None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.365676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1d31610f-674d-4920-afce-721ccbc4a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:48.391343 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31610f-674d-4920-afce-721ccbc4a4ae None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.396350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.397004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.397287 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.397564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] PATH_INFO: `/v3/projects/cf3a864b8aae42759cc3c276b352ce9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.399159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3a864b8aae42759cc3c276b352ce9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.402671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.465679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3a864b8aae42759cc3c276b352ce9c', 'request_id': 'req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.475519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3a864b8aae42759cc3c276b352ce9c', 'request_id': 'req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.485939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3a864b8aae42759cc3c276b352ce9c', 'request_id': 'req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.500626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] The token cache is being invalidate because project cf3a864b8aae42759cc3c276b352ce9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:48.501009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.501628 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.503247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1361/2732] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:48 2022] DELETE /identity/v3/projects/cf3a864b8aae42759cc3c276b352ce9c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:48.509267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18e072-1267-4405-831d-14b9a655945f service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.521313 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18e072-1267-4405-831d-14b9a655945f service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.585410 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.612508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.613063 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.613337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.613602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] PATH_INFO: `/v3/users/04f7c8cf80ed4c0085d8db7ebf411fa9` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.616962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f7c8cf80ed4c0085d8db7ebf411fa9)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.619145 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.682473 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f7c8cf80ed4c0085d8db7ebf411fa9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.683143 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f7c8cf80ed4c0085d8db7ebf411fa9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.699085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f7c8cf80ed4c0085d8db7ebf411fa9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.707823 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f7c8cf80ed4c0085d8db7ebf411fa9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.708616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-019bed2b-d4a2-439a-9fca-6d9d5454b354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f7c8cf80ed4c0085d8db7ebf411fa9'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.722979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1372/2733] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:48 2022] DELETE /identity/v3/users/04f7c8cf80ed4c0085d8db7ebf411fa9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:49.072463 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.074318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.104586 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425dfcf-3c33-4d72-b17b-4a1ec04d3589 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.196833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.197517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.197833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.198113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] PATH_INFO: `/v3/projects/58c06c5dcd344e9f9e33c768f02f4c0e` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.199485 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c06c5dcd344e9f9e33c768f02f4c0e)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.201872 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.264831 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c06c5dcd344e9f9e33c768f02f4c0e', 'request_id': 'req-b78c432d-5bec-4902-a1ee-aa976d191602'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.271726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c06c5dcd344e9f9e33c768f02f4c0e', 'request_id': 'req-b78c432d-5bec-4902-a1ee-aa976d191602'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.280399 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c06c5dcd344e9f9e33c768f02f4c0e', 'request_id': 'req-b78c432d-5bec-4902-a1ee-aa976d191602'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.288687 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.301247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] The token cache is being invalidate because project 58c06c5dcd344e9f9e33c768f02f4c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:49.301571 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.302335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-b78c432d-5bec-4902-a1ee-aa976d191602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.304066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1362/2734] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:49 2022] DELETE /identity/v3/projects/58c06c5dcd344e9f9e33c768f02f4c0e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:49.310582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa154b-9cec-40ea-a228-8c9a0334df2d None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.311621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa154b-9cec-40ea-a228-8c9a0334df2d None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.312008 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa154b-9cec-40ea-a228-8c9a0334df2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.339395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-e1aa154b-9cec-40ea-a228-8c9a0334df2d None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:49.343959 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e1aa154b-9cec-40ea-a228-8c9a0334df2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.407876 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1373/2735] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:49.418306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d9b52-d106-45f8-8c22-a7f46448d3af None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.418306 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d9b52-d106-45f8-8c22-a7f46448d3af None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.418983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d9b52-d106-45f8-8c22-a7f46448d3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.442305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9e5d9b52-d106-45f8-8c22-a7f46448d3af None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:49.443595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9e5d9b52-d106-45f8-8c22-a7f46448d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.453852 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1363/2736] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:49.457887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa154b-9cec-40ea-a228-8c9a0334df2d None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.469017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa154b-9cec-40ea-a228-8c9a0334df2d None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.474732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3155b-e005-43ad-9f89-62d159fc4668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.475445 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3155b-e005-43ad-9f89-62d159fc4668 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.475788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3155b-e005-43ad-9f89-62d159fc4668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.476192 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3155b-e005-43ad-9f89-62d159fc4668 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.479233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3155b-e005-43ad-9f89-62d159fc4668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:49.479233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3155b-e005-43ad-9f89-62d159fc4668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.479233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3155b-e005-43ad-9f89-62d159fc4668 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.492196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1374/2737] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:49.497131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d9b52-d106-45f8-8c22-a7f46448d3af None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.509822 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d9b52-d106-45f8-8c22-a7f46448d3af None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.522503 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9831d80-1c7f-4732-abab-59d069995723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.523433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9831d80-1c7f-4732-abab-59d069995723 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.523826 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9831d80-1c7f-4732-abab-59d069995723 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.524168 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9831d80-1c7f-4732-abab-59d069995723 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.525014 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9831d80-1c7f-4732-abab-59d069995723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.527443 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9831d80-1c7f-4732-abab-59d069995723 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.570591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1364/2738] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:49.575038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3155b-e005-43ad-9f89-62d159fc4668 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.588087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3155b-e005-43ad-9f89-62d159fc4668 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.656381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.681607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39236fb8-9b42-4768-8e20-1bd8f1caf49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.682366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39236fb8-9b42-4768-8e20-1bd8f1caf49a admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.682840 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39236fb8-9b42-4768-8e20-1bd8f1caf49a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.683180 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39236fb8-9b42-4768-8e20-1bd8f1caf49a admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.684307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39236fb8-9b42-4768-8e20-1bd8f1caf49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.687003 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39236fb8-9b42-4768-8e20-1bd8f1caf49a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.718899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1375/2739] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:49.722433 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9831d80-1c7f-4732-abab-59d069995723 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.733932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9831d80-1c7f-4732-abab-59d069995723 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.740877 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff1f63-0fee-4420-af15-567d3adce7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.741976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1f63-0fee-4420-af15-567d3adce7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.742350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1f63-0fee-4420-af15-567d3adce7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.742727 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1f63-0fee-4420-af15-567d3adce7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.743517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff1f63-0fee-4420-af15-567d3adce7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.745420 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff1f63-0fee-4420-af15-567d3adce7e5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.759668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1365/2740] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:49.764968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39236fb8-9b42-4768-8e20-1bd8f1caf49a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.775669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39236fb8-9b42-4768-8e20-1bd8f1caf49a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.782709 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b646b-69e8-49b3-b05e-189c1b7e2b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.783594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b646b-69e8-49b3-b05e-189c1b7e2b76 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.783871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b646b-69e8-49b3-b05e-189c1b7e2b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.784137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b646b-69e8-49b3-b05e-189c1b7e2b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.784789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b646b-69e8-49b3-b05e-189c1b7e2b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.786414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b646b-69e8-49b3-b05e-189c1b7e2b76 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.800590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1376/2741] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:49.804767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff1f63-0fee-4420-af15-567d3adce7e5 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.815824 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff1f63-0fee-4420-af15-567d3adce7e5 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.820673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae2881-1d7d-43f6-be57-c7df5f902ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.821375 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae2881-1d7d-43f6-be57-c7df5f902ade admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.821626 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae2881-1d7d-43f6-be57-c7df5f902ade admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.821912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae2881-1d7d-43f6-be57-c7df5f902ade admin admin] PATH_INFO: `/v3/projects/5b2afca61c8b41d187f00a68a70ab8e7/users/5e929c4c77e64dc1ba90e84dff3202df/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.839917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae2881-1d7d-43f6-be57-c7df5f902ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2afca61c8b41d187f00a68a70ab8e7, user_id=5e929c4c77e64dc1ba90e84dff3202df, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.843133 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae2881-1d7d-43f6-be57-c7df5f902ade admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.871801 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54885f-9e5e-4b9c-bc53-0dd6ec02eb86 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.872093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54885f-9e5e-4b9c-bc53-0dd6ec02eb86 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.872424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54885f-9e5e-4b9c-bc53-0dd6ec02eb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.876435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1366/2742] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:49 2022] PUT /identity/v3/projects/5b2afca61c8b41d187f00a68a70ab8e7/users/5e929c4c77e64dc1ba90e84dff3202df/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:49.912822 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-cd54885f-9e5e-4b9c-bc53-0dd6ec02eb86 None None] MFA Rules not processed for user `5e929c4c77e64dc1ba90e84dff3202df`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:49.914359 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-cd54885f-9e5e-4b9c-bc53-0dd6ec02eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:50.012963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1377/2743] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:50.023818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae2881-1d7d-43f6-be57-c7df5f902ade admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.025700 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-25ae2881-1d7d-43f6-be57-c7df5f902ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:50.100252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae2881-1d7d-43f6-be57-c7df5f902ade admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.104186 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a624a75-567a-44ac-8875-3f66009fefee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.104888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624a75-567a-44ac-8875-3f66009fefee service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.105365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624a75-567a-44ac-8875-3f66009fefee service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.105701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624a75-567a-44ac-8875-3f66009fefee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.117096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a624a75-567a-44ac-8875-3f66009fefee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.118724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a624a75-567a-44ac-8875-3f66009fefee service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.132663 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1367/2744] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:52.705393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606acdb0-32c6-4db4-a3ee-3cda90d0b95b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.705918 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606acdb0-32c6-4db4-a3ee-3cda90d0b95b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.706039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606acdb0-32c6-4db4-a3ee-3cda90d0b95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.725283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-606acdb0-32c6-4db4-a3ee-3cda90d0b95b None None] MFA Rules not processed for user `6832971a34de4eb39981c57152c7c5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:52.726537 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-606acdb0-32c6-4db4-a3ee-3cda90d0b95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:52.783590 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1378/2745] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:53.068274 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a624a75-567a-44ac-8875-3f66009fefee service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.069905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7a624a75-567a-44ac-8875-3f66009fefee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:53.134717 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a624a75-567a-44ac-8875-3f66009fefee service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.139444 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.139950 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.140235 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.140548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.142402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:53.152502 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.154220 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.163312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1368/2746] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:54.712713 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8525fb-a52a-4bae-94a4-43f093db01ff None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.713244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8525fb-a52a-4bae-94a4-43f093db01ff None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.713244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8525fb-a52a-4bae-94a4-43f093db01ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.734653 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-2c8525fb-a52a-4bae-94a4-43f093db01ff None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:54.736081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2c8525fb-a52a-4bae-94a4-43f093db01ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:54.800716 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1379/2747] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:54.815148 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.817066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:54.860663 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.898202 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec533a-e5a5-4258-8d17-679b426b5b93 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.904710 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd44de-8d72-4dc5-a988-129589db05d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.905401 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd44de-8d72-4dc5-a988-129589db05d3 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.905750 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd44de-8d72-4dc5-a988-129589db05d3 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.906091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd44de-8d72-4dc5-a988-129589db05d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.914669 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd44de-8d72-4dc5-a988-129589db05d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.916379 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd44de-8d72-4dc5-a988-129589db05d3 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.925873 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1369/2748] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:53:55.714994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8525fb-a52a-4bae-94a4-43f093db01ff None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.736949 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.804752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8525fb-a52a-4bae-94a4-43f093db01ff None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.809651 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.810464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.810751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.811070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] PATH_INFO: `/v3/users/5e929c4c77e64dc1ba90e84dff3202df` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.812228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e929c4c77e64dc1ba90e84dff3202df)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.814344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.886010 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e929c4c77e64dc1ba90e84dff3202df'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.887121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e929c4c77e64dc1ba90e84dff3202df'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.903938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e929c4c77e64dc1ba90e84dff3202df'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.916019 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e929c4c77e64dc1ba90e84dff3202df'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.922736 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e929c4c77e64dc1ba90e84dff3202df'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.937755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1380/2749] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:55 2022] DELETE /identity/v3/users/5e929c4c77e64dc1ba90e84dff3202df => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:55.942423 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50241e-99b2-4195-b3e9-72e367e2e3c1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.942954 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50241e-99b2-4195-b3e9-72e367e2e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.943055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50241e-99b2-4195-b3e9-72e367e2e3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.964217 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5a50241e-99b2-4195-b3e9-72e367e2e3c1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:55.966422 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5a50241e-99b2-4195-b3e9-72e367e2e3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:56.043307 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1370/2750] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:56.052652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.054122 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:56.121191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb847794-ec85-485a-aefa-81aa81f843bc admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.125205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83d9cb-3b28-4487-bcb2-ad1d8c11734e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.125884 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83d9cb-3b28-4487-bcb2-ad1d8c11734e service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.126231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83d9cb-3b28-4487-bcb2-ad1d8c11734e service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.126635 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83d9cb-3b28-4487-bcb2-ad1d8c11734e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.138132 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83d9cb-3b28-4487-bcb2-ad1d8c11734e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.139607 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83d9cb-3b28-4487-bcb2-ad1d8c11734e service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.151295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1381/2751] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:56.452739 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50241e-99b2-4195-b3e9-72e367e2e3c1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.454511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5a50241e-99b2-4195-b3e9-72e367e2e3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:56.470105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50241e-99b2-4195-b3e9-72e367e2e3c1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.475539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.476197 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.476779 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.477059 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] PATH_INFO: `/v3/projects/5b2afca61c8b41d187f00a68a70ab8e7` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.478236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2afca61c8b41d187f00a68a70ab8e7)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.480351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.551262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2afca61c8b41d187f00a68a70ab8e7', 'request_id': 'req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.558609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2afca61c8b41d187f00a68a70ab8e7', 'request_id': 'req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.570049 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2afca61c8b41d187f00a68a70ab8e7', 'request_id': 'req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.584709 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] The token cache is being invalidate because project 5b2afca61c8b41d187f00a68a70ab8e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:56.585046 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.585655 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-9cd348dd-dcc3-4244-8172-cedc9f9aeb30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.587365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1371/2752] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:56 2022] DELETE /identity/v3/projects/5b2afca61c8b41d187f00a68a70ab8e7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:56.593864 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0e5a-d7d7-49e3-9b9c-3b7a27a53bc5 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.594150 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0e5a-d7d7-49e3-9b9c-3b7a27a53bc5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.594424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0e5a-d7d7-49e3-9b9c-3b7a27a53bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.615267 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-36eb0e5a-d7d7-49e3-9b9c-3b7a27a53bc5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:56.616481 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-36eb0e5a-d7d7-49e3-9b9c-3b7a27a53bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:56.643719 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.703961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1382/2753] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:56.711926 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38782-cac0-4db3-b68c-a0a9a89e5f3a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.712216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38782-cac0-4db3-b68c-a0a9a89e5f3a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.712493 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38782-cac0-4db3-b68c-a0a9a89e5f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.734589 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-39e38782-cac0-4db3-b68c-a0a9a89e5f3a None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:56.735924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-39e38782-cac0-4db3-b68c-a0a9a89e5f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:56.745578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1372/2754] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:56.752185 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb0e5a-d7d7-49e3-9b9c-3b7a27a53bc5 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.763312 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb0e5a-d7d7-49e3-9b9c-3b7a27a53bc5 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.768027 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfafbaf-a72c-4d19-8e89-225a674035dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.768726 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfafbaf-a72c-4d19-8e89-225a674035dd admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.769070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfafbaf-a72c-4d19-8e89-225a674035dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.769344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfafbaf-a72c-4d19-8e89-225a674035dd admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.770210 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfafbaf-a72c-4d19-8e89-225a674035dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:56.770518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfafbaf-a72c-4d19-8e89-225a674035dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.772484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfafbaf-a72c-4d19-8e89-225a674035dd admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.787081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1383/2755] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:56.791772 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38782-cac0-4db3-b68c-a0a9a89e5f3a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.801204 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38782-cac0-4db3-b68c-a0a9a89e5f3a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.805821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d571b5-964c-4097-9732-bdb0fd2f6aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.806419 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d571b5-964c-4097-9732-bdb0fd2f6aed admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.806699 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d571b5-964c-4097-9732-bdb0fd2f6aed admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.807000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d571b5-964c-4097-9732-bdb0fd2f6aed admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.807621 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d571b5-964c-4097-9732-bdb0fd2f6aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.809522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d571b5-964c-4097-9732-bdb0fd2f6aed admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.839068 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1373/2756] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:56 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:56.844052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfafbaf-a72c-4d19-8e89-225a674035dd admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.861431 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfafbaf-a72c-4d19-8e89-225a674035dd admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.935598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ad652-da85-4b3b-a01b-5cb003ad070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.936519 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ad652-da85-4b3b-a01b-5cb003ad070e admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.936890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ad652-da85-4b3b-a01b-5cb003ad070e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.937260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ad652-da85-4b3b-a01b-5cb003ad070e admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.938095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ad652-da85-4b3b-a01b-5cb003ad070e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.942694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ad652-da85-4b3b-a01b-5cb003ad070e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.972564 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1384/2757] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:56 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:56.974079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d571b5-964c-4097-9732-bdb0fd2f6aed admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.985225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d571b5-964c-4097-9732-bdb0fd2f6aed admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.990250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861d534-c022-420c-92f7-7dab8ab1338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.990967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d534-c022-420c-92f7-7dab8ab1338a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.991252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d534-c022-420c-92f7-7dab8ab1338a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.991521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d534-c022-420c-92f7-7dab8ab1338a admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.992163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d534-c022-420c-92f7-7dab8ab1338a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.994035 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d534-c022-420c-92f7-7dab8ab1338a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.006587 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1374/2758] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:57.011023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ad652-da85-4b3b-a01b-5cb003ad070e admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.027211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ad652-da85-4b3b-a01b-5cb003ad070e admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.043090 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9c922-d2bc-4b2c-a2c3-033f35d3cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.043783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9c922-d2bc-4b2c-a2c3-033f35d3cf14 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.044582 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9c922-d2bc-4b2c-a2c3-033f35d3cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.044858 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9c922-d2bc-4b2c-a2c3-033f35d3cf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.045522 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9c922-d2bc-4b2c-a2c3-033f35d3cf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.047391 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9c922-d2bc-4b2c-a2c3-033f35d3cf14 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.067796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1385/2759] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:53:57.071859 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861d534-c022-420c-92f7-7dab8ab1338a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.093809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861d534-c022-420c-92f7-7dab8ab1338a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.105484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b083c-415e-4d8e-9a6e-37a37aa6f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.106175 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b083c-415e-4d8e-9a6e-37a37aa6f2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.106679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b083c-415e-4d8e-9a6e-37a37aa6f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.106990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b083c-415e-4d8e-9a6e-37a37aa6f2d0 admin admin] PATH_INFO: `/v3/projects/ce1a2deaf69343619d85c9abd2a829de/users/e48eb6dc6cc84848ad325ea9f2d7b2ac/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.111984 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.127663 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b083c-415e-4d8e-9a6e-37a37aa6f2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1a2deaf69343619d85c9abd2a829de, user_id=e48eb6dc6cc84848ad325ea9f2d7b2ac, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.131018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b083c-415e-4d8e-9a6e-37a37aa6f2d0 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.162680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1375/2760] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:57 2022] PUT /identity/v3/projects/ce1a2deaf69343619d85c9abd2a829de/users/e48eb6dc6cc84848ad325ea9f2d7b2ac/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:57.174640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf53505-ac94-480f-948c-9662e95e35cd None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.174996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf53505-ac94-480f-948c-9662e95e35cd None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.175217 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf53505-ac94-480f-948c-9662e95e35cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.210425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-0cf53505-ac94-480f-948c-9662e95e35cd None None] MFA Rules not processed for user `e48eb6dc6cc84848ad325ea9f2d7b2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:57.211525 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0cf53505-ac94-480f-948c-9662e95e35cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:57.287856 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1386/2761] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:57.300498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b083c-415e-4d8e-9a6e-37a37aa6f2d0 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.302388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b64b083c-415e-4d8e-9a6e-37a37aa6f2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:57.376642 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b083c-415e-4d8e-9a6e-37a37aa6f2d0 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.380240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eeb42-5d00-4f61-8977-78fc0d8ff921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.381114 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eeb42-5d00-4f61-8977-78fc0d8ff921 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.381393 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eeb42-5d00-4f61-8977-78fc0d8ff921 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.381664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eeb42-5d00-4f61-8977-78fc0d8ff921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.395069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95eeb42-5d00-4f61-8977-78fc0d8ff921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.395069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95eeb42-5d00-4f61-8977-78fc0d8ff921 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.404927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1376/2762] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:02.689138 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf53505-ac94-480f-948c-9662e95e35cd None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.720277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:02.760092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf53505-ac94-480f-948c-9662e95e35cd None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.765755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.766388 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.766667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.766963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] PATH_INFO: `/v3/users/e48eb6dc6cc84848ad325ea9f2d7b2ac` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.768081 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48eb6dc6cc84848ad325ea9f2d7b2ac)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.770018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.826094 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48eb6dc6cc84848ad325ea9f2d7b2ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.826889 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48eb6dc6cc84848ad325ea9f2d7b2ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.840123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48eb6dc6cc84848ad325ea9f2d7b2ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.849634 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48eb6dc6cc84848ad325ea9f2d7b2ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.850290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48eb6dc6cc84848ad325ea9f2d7b2ac'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.863905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1387/2763] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:02 2022] DELETE /identity/v3/users/e48eb6dc6cc84848ad325ea9f2d7b2ac => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:02.868531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0c565-207c-4aa4-ac5c-3960c634a873 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.869330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0c565-207c-4aa4-ac5c-3960c634a873 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.869330 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0c565-207c-4aa4-ac5c-3960c634a873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.891581 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-39a0c565-207c-4aa4-ac5c-3960c634a873 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.892856 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-39a0c565-207c-4aa4-ac5c-3960c634a873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.960874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1377/2764] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:02.971447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.973013 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:03.038171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcc14f-af4a-4675-9781-3a1e5aa56071 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.042664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c807ed-b48f-48ce-90c3-176e39766e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.044534 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c807ed-b48f-48ce-90c3-176e39766e82 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.044813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c807ed-b48f-48ce-90c3-176e39766e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.045211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c807ed-b48f-48ce-90c3-176e39766e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.058274 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c807ed-b48f-48ce-90c3-176e39766e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.060324 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c807ed-b48f-48ce-90c3-176e39766e82 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.070602 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1388/2765] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:03.391884 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0c565-207c-4aa4-ac5c-3960c634a873 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.393953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-39a0c565-207c-4aa4-ac5c-3960c634a873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:03.409519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0c565-207c-4aa4-ac5c-3960c634a873 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.414584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.415285 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.415904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.415904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] PATH_INFO: `/v3/projects/ce1a2deaf69343619d85c9abd2a829de` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.416977 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1a2deaf69343619d85c9abd2a829de)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.420020 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.471063 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1a2deaf69343619d85c9abd2a829de', 'request_id': 'req-566218cd-78da-4925-b8e7-6e21e7944f8f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:03.477521 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1a2deaf69343619d85c9abd2a829de', 'request_id': 'req-566218cd-78da-4925-b8e7-6e21e7944f8f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:03.485861 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1a2deaf69343619d85c9abd2a829de', 'request_id': 'req-566218cd-78da-4925-b8e7-6e21e7944f8f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:03.497236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] The token cache is being invalidate because project ce1a2deaf69343619d85c9abd2a829de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:03.497522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:03.498155 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:03.499907 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1378/2766] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:03 2022] DELETE /identity/v3/projects/ce1a2deaf69343619d85c9abd2a829de => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:08.627749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c807ed-b48f-48ce-90c3-176e39766e82 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:08.629200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f6c807ed-b48f-48ce-90c3-176e39766e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.691386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:08.723264 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c807ed-b48f-48ce-90c3-176e39766e82 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:08.815464 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58495b-3fcd-4fe2-a116-bd3280be9ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:08.816408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58495b-3fcd-4fe2-a116-bd3280be9ddf service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.816692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58495b-3fcd-4fe2-a116-bd3280be9ddf service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.816965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58495b-3fcd-4fe2-a116-bd3280be9ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.819032 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3a58495b-3fcd-4fe2-a116-bd3280be9ddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.835103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58495b-3fcd-4fe2-a116-bd3280be9ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:08.836636 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58495b-3fcd-4fe2-a116-bd3280be9ddf service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:08.850219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1389/2767] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:12.578413 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.579986 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:12.594570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:12.643721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566218cd-78da-4925-b8e7-6e21e7944f8f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.647331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.647935 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.648214 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.648489 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.650212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:12.717897 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.719388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.729081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1379/2768] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:16.908694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58495b-3fcd-4fe2-a116-bd3280be9ddf service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:16.926680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58495b-3fcd-4fe2-a116-bd3280be9ddf service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:16.930601 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:16.931321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:16.931663 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:16.931998 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:16.933978 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:17.010409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:17.012135 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.024123 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1390/2769] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:17.176915 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.178321 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:17.240115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39475ac-4eed-494b-8f5e-f5ab01be4321 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:17.243765 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:17.244392 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.244675 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.245139 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.248498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:17.320484 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:17.321499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.331827 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1380/2770] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:20.473006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:20.483219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:20.628948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4f238-160c-4fe2-8436-1fa88fb5c4ac service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:20.637290 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccfb96-54f8-4f67-8382-66f7a729c245 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:20.639044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccfb96-54f8-4f67-8382-66f7a729c245 service placement] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:20.639603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccfb96-54f8-4f67-8382-66f7a729c245 service placement] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:20.640096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccfb96-54f8-4f67-8382-66f7a729c245 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:20.642695 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c6ccfb96-54f8-4f67-8382-66f7a729c245 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:20.678245 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=100 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:20.682250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccfb96-54f8-4f67-8382-66f7a729c245 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:20.684579 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccfb96-54f8-4f67-8382-66f7a729c245 service placement] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:20.712313 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:20.713996 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:20.718049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1391/2771] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:20.768067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a73544-1869-45c5-9f2a-6454a12c19ec service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:20.791890 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:20.792990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:20.796682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:20.798701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] PATH_INFO: `/v3/users/fd345c0cb98d4646b0e056ff7953fd5c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:20.801348 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd345c0cb98d4646b0e056ff7953fd5c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:20.805190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:20.847249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:20.931279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd345c0cb98d4646b0e056ff7953fd5c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:20.951211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd345c0cb98d4646b0e056ff7953fd5c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:20.965513 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd345c0cb98d4646b0e056ff7953fd5c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:20.988722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd345c0cb98d4646b0e056ff7953fd5c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:20.990797 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd345c0cb98d4646b0e056ff7953fd5c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.011328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1381/2772] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:20 2022] DELETE /identity/v3/users/fd345c0cb98d4646b0e056ff7953fd5c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:21.234016 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccfb96-54f8-4f67-8382-66f7a729c245 service placement] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:21.270183 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccfb96-54f8-4f67-8382-66f7a729c245 service placement] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:21.425699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:21.426352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.426632 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.426952 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] PATH_INFO: `/v3/projects/53abd6616db243088645bfb5850143ef` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.428124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=53abd6616db243088645bfb5850143ef)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:21.430413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:21.504166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53abd6616db243088645bfb5850143ef', 'request_id': 'req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.512213 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53abd6616db243088645bfb5850143ef', 'request_id': 'req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.527973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53abd6616db243088645bfb5850143ef', 'request_id': 'req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.553930 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] The token cache is being invalidate because project 53abd6616db243088645bfb5850143ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:21.554228 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.554936 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.569515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:21.569724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1392/2773] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:21 2022] DELETE /identity/v3/projects/53abd6616db243088645bfb5850143ef => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:21.570257 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:21.584730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b6476-9f9a-4012-bcb1-b538956604ee admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:21.676564 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:21.677314 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.677656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.678000 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] PATH_INFO: `/v3/users/67bf2b9788f44eeaa8fc79f20e019bed` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.679402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bf2b9788f44eeaa8fc79f20e019bed)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:21.681478 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:21.739011 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bf2b9788f44eeaa8fc79f20e019bed'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.749953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bf2b9788f44eeaa8fc79f20e019bed'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.759454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bf2b9788f44eeaa8fc79f20e019bed'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.775927 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bf2b9788f44eeaa8fc79f20e019bed'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.776862 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bf2b9788f44eeaa8fc79f20e019bed'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:21.785124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1382/2774] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:21 2022] DELETE /identity/v3/users/67bf2b9788f44eeaa8fc79f20e019bed => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:22.005939 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.007456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:22.021774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4de2a-1723-46a8-9c7f-a5a9ef6006fd admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:22.096404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:22.097287 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.097785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.098128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] PATH_INFO: `/v3/projects/6759e21ab6ad449880ed3efdbcddf297` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.100722 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6759e21ab6ad449880ed3efdbcddf297)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.104221 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.152588 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:22.184053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6759e21ab6ad449880ed3efdbcddf297', 'request_id': 'req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:22.192260 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6759e21ab6ad449880ed3efdbcddf297', 'request_id': 'req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:22.203768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6759e21ab6ad449880ed3efdbcddf297', 'request_id': 'req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:22.221299 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] The token cache is being invalidate because project 6759e21ab6ad449880ed3efdbcddf297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:22.221694 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:22.222621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:22.225368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1393/2775] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:22 2022] DELETE /identity/v3/projects/6759e21ab6ad449880ed3efdbcddf297 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:24.855819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.857499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:24.867216 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:24.921123 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86a7cf-1671-4c49-ab26-8bde305dfc44 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.970659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69387b-22c9-4a27-9604-a4c357ace844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.971297 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69387b-22c9-4a27-9604-a4c357ace844 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.971582 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69387b-22c9-4a27-9604-a4c357ace844 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.971857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69387b-22c9-4a27-9604-a4c357ace844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.973776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ec69387b-22c9-4a27-9604-a4c357ace844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:25.036932 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69387b-22c9-4a27-9604-a4c357ace844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:25.038416 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69387b-22c9-4a27-9604-a4c357ace844 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:25.049342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1383/2776] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:28.259468 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.261088 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:28.274848 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ee08-d34e-4e4e-9b9a-7b5578183545 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.279707 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.280337 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.280618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.281425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] PATH_INFO: `/v3/users/40c7c0ae1660404b8ec1e3eae0eb92e5` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.282042 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c7c0ae1660404b8ec1e3eae0eb92e5)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.284072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.330404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c7c0ae1660404b8ec1e3eae0eb92e5'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.331070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c7c0ae1660404b8ec1e3eae0eb92e5'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.343453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c7c0ae1660404b8ec1e3eae0eb92e5'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.351788 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c7c0ae1660404b8ec1e3eae0eb92e5'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.352406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-9ce8bddd-4645-4a5f-a3ff-535eebb25785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c7c0ae1660404b8ec1e3eae0eb92e5'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.366697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1394/2777] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:28 2022] DELETE /identity/v3/users/40c7c0ae1660404b8ec1e3eae0eb92e5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:28.546408 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69387b-22c9-4a27-9604-a4c357ace844 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.557190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69387b-22c9-4a27-9604-a4c357ace844 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.620435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.621078 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.621404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.621677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] PATH_INFO: `/v3/projects/214ad6d03907498aa57074b0a51b93b0` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.622837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=214ad6d03907498aa57074b0a51b93b0)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.624787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.640998 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:28.675908 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214ad6d03907498aa57074b0a51b93b0', 'request_id': 'req-254c189a-052b-4157-b344-7a33d120fb0f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.682180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214ad6d03907498aa57074b0a51b93b0', 'request_id': 'req-254c189a-052b-4157-b344-7a33d120fb0f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.690491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214ad6d03907498aa57074b0a51b93b0', 'request_id': 'req-254c189a-052b-4157-b344-7a33d120fb0f'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.702151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] The token cache is being invalidate because project 214ad6d03907498aa57074b0a51b93b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:28.702442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.703124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-254c189a-052b-4157-b344-7a33d120fb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.704741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1384/2778] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:28 2022] DELETE /identity/v3/projects/214ad6d03907498aa57074b0a51b93b0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:28.713341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c110e-2030-4abe-8fb8-c8fbc52974ac None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.713631 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c110e-2030-4abe-8fb8-c8fbc52974ac None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.713911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c110e-2030-4abe-8fb8-c8fbc52974ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.734805 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-037c110e-2030-4abe-8fb8-c8fbc52974ac None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:28.736059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-037c110e-2030-4abe-8fb8-c8fbc52974ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:28.795141 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1395/2779] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:28.803779 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70186fd-62c5-494f-b10f-5fad242ef150 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.804076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70186fd-62c5-494f-b10f-5fad242ef150 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.804356 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70186fd-62c5-494f-b10f-5fad242ef150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.825181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a70186fd-62c5-494f-b10f-5fad242ef150 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:28.826696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a70186fd-62c5-494f-b10f-5fad242ef150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:28.834945 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1385/2780] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:28.839309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c110e-2030-4abe-8fb8-c8fbc52974ac None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.850196 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c110e-2030-4abe-8fb8-c8fbc52974ac None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.855609 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597fc9d-99b9-44f3-8e29-192a7383ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.856693 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597fc9d-99b9-44f3-8e29-192a7383ba61 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.856979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597fc9d-99b9-44f3-8e29-192a7383ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.857254 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597fc9d-99b9-44f3-8e29-192a7383ba61 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.857905 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597fc9d-99b9-44f3-8e29-192a7383ba61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:28.858216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597fc9d-99b9-44f3-8e29-192a7383ba61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.859871 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597fc9d-99b9-44f3-8e29-192a7383ba61 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.872177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1396/2781] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:28.876849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70186fd-62c5-494f-b10f-5fad242ef150 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.886707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70186fd-62c5-494f-b10f-5fad242ef150 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.892105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0175c-44f8-492b-97aa-a04dc8af7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.892679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0175c-44f8-492b-97aa-a04dc8af7cdc admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.892956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0175c-44f8-492b-97aa-a04dc8af7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.893226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0175c-44f8-492b-97aa-a04dc8af7cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.893850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0175c-44f8-492b-97aa-a04dc8af7cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.895847 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0175c-44f8-492b-97aa-a04dc8af7cdc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.927674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1386/2782] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:28.931846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597fc9d-99b9-44f3-8e29-192a7383ba61 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.942170 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597fc9d-99b9-44f3-8e29-192a7383ba61 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.956059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:29.009050 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfad5a-5501-487d-afa2-d1e7b8c531db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.009687 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfad5a-5501-487d-afa2-d1e7b8c531db admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.009965 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfad5a-5501-487d-afa2-d1e7b8c531db admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.010352 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfad5a-5501-487d-afa2-d1e7b8c531db admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.011190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfad5a-5501-487d-afa2-d1e7b8c531db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.014683 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfad5a-5501-487d-afa2-d1e7b8c531db admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.041794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1397/2783] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:29.046473 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0175c-44f8-492b-97aa-a04dc8af7cdc admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.056858 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0175c-44f8-492b-97aa-a04dc8af7cdc admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.062350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b10a-bcc2-4547-9731-110437303937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.062990 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b10a-bcc2-4547-9731-110437303937 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.063273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b10a-bcc2-4547-9731-110437303937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.063546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b10a-bcc2-4547-9731-110437303937 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.064188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7b10a-bcc2-4547-9731-110437303937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.065815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7b10a-bcc2-4547-9731-110437303937 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.077152 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1387/2784] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:29.081177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfad5a-5501-487d-afa2-d1e7b8c531db admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.092521 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfad5a-5501-487d-afa2-d1e7b8c531db admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.097216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b71b8-fd5f-4685-b1cd-fadfdf5bf419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.097818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b71b8-fd5f-4685-b1cd-fadfdf5bf419 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.098099 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b71b8-fd5f-4685-b1cd-fadfdf5bf419 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.098397 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b71b8-fd5f-4685-b1cd-fadfdf5bf419 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.099049 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b71b8-fd5f-4685-b1cd-fadfdf5bf419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.100643 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b71b8-fd5f-4685-b1cd-fadfdf5bf419 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.111892 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1398/2785] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:29.116281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b10a-bcc2-4547-9731-110437303937 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.127290 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b10a-bcc2-4547-9731-110437303937 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.132250 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049639c9-1543-4913-a3a2-a511f181880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.132912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049639c9-1543-4913-a3a2-a511f181880d admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.133190 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049639c9-1543-4913-a3a2-a511f181880d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.133466 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049639c9-1543-4913-a3a2-a511f181880d admin admin] PATH_INFO: `/v3/projects/58e80f05fe4844b2ad517d1d721d2498/users/0225a9543da6435bb0e87f1a764d0f50/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.150256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049639c9-1543-4913-a3a2-a511f181880d admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e80f05fe4844b2ad517d1d721d2498, user_id=0225a9543da6435bb0e87f1a764d0f50, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.153749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049639c9-1543-4913-a3a2-a511f181880d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.166370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1388/2786] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:29 2022] PUT /identity/v3/projects/58e80f05fe4844b2ad517d1d721d2498/users/0225a9543da6435bb0e87f1a764d0f50/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:29.171896 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c10b-762f-470a-aa85-b3e32c6dc271 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.172227 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c10b-762f-470a-aa85-b3e32c6dc271 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.172539 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c10b-762f-470a-aa85-b3e32c6dc271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.193618 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-c6d9c10b-762f-470a-aa85-b3e32c6dc271 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:29.194869 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c6d9c10b-762f-470a-aa85-b3e32c6dc271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:29.257061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1399/2787] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:29.267486 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049639c9-1543-4913-a3a2-a511f181880d admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.269200 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-049639c9-1543-4913-a3a2-a511f181880d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:29.325671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049639c9-1543-4913-a3a2-a511f181880d admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.329289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f73e-d0cf-4a7b-af59-4b1323e40d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.329886 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f73e-d0cf-4a7b-af59-4b1323e40d44 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.330159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f73e-d0cf-4a7b-af59-4b1323e40d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.330427 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f73e-d0cf-4a7b-af59-4b1323e40d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.339329 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1f73e-d0cf-4a7b-af59-4b1323e40d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.340812 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1f73e-d0cf-4a7b-af59-4b1323e40d44 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.350163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1389/2788] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:33.462161 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca68ab1-d3a4-4220-b24d-18961ef102a7 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.462662 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca68ab1-d3a4-4220-b24d-18961ef102a7 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.462755 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca68ab1-d3a4-4220-b24d-18961ef102a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.503106 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-7ca68ab1-d3a4-4220-b24d-18961ef102a7 None None] MFA Rules not processed for user `0225a9543da6435bb0e87f1a764d0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:33.504366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-7ca68ab1-d3a4-4220-b24d-18961ef102a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:33.576948 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1400/2789] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:33.591029 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f73e-d0cf-4a7b-af59-4b1323e40d44 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:33.593064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8fe1f73e-d0cf-4a7b-af59-4b1323e40d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:33.649247 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:33.700305 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f73e-d0cf-4a7b-af59-4b1323e40d44 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:33.705789 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaa742-0709-4997-8aad-3de9add348c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:33.706398 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaa742-0709-4997-8aad-3de9add348c5 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.706679 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaa742-0709-4997-8aad-3de9add348c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.706982 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaa742-0709-4997-8aad-3de9add348c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.718334 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaa742-0709-4997-8aad-3de9add348c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:33.721103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaa742-0709-4997-8aad-3de9add348c5 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:33.735201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1390/2790] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:35.102569 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490b964-9f01-4361-840d-725f416672d1 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.103128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490b964-9f01-4361-840d-725f416672d1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.103128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490b964-9f01-4361-840d-725f416672d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.125175 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-2490b964-9f01-4361-840d-725f416672d1 None None] MFA Rules not processed for user `0225a9543da6435bb0e87f1a764d0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:35.126499 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-2490b964-9f01-4361-840d-725f416672d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:35.135072 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1401/2791] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:43.728960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=15 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:45.117906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:43.447525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaa742-0709-4997-8aad-3de9add348c5 service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:43.449524 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1caaa742-0709-4997-8aad-3de9add348c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:43.620080 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaa742-0709-4997-8aad-3de9add348c5 service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:43.626758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:43.627403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:43.627697 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:43.627956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:43.630244 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:43.655410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:43.657018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:43.667407 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1391/2792] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:45.616393 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa712-6349-4162-b2fa-e95257677c79 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:45.616917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa712-6349-4162-b2fa-e95257677c79 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:45.617033 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa712-6349-4162-b2fa-e95257677c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:45.645961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-9e1aa712-6349-4162-b2fa-e95257677c79 None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:45.647200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9e1aa712-6349-4162-b2fa-e95257677c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:45.708298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1402/2793] 10.222.0.65 () {58 vars in 967 bytes} [Thu Aug 18 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:45.752636 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:45.754084 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:45.825187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de0158-2cdd-48fc-922a-e14e4565306e service placement] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:45.830100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91ea7-b30c-4530-8f2c-83ae31f0bd21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:45.830703 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91ea7-b30c-4530-8f2c-83ae31f0bd21 service swift] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:45.831010 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91ea7-b30c-4530-8f2c-83ae31f0bd21 service swift] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:45.831282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91ea7-b30c-4530-8f2c-83ae31f0bd21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:45.839253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e91ea7-b30c-4530-8f2c-83ae31f0bd21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:45.841892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e91ea7-b30c-4530-8f2c-83ae31f0bd21 service swift] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:45.849971 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1392/2794] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:55:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:55:52.826887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa712-6349-4162-b2fa-e95257677c79 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:52.828436 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9e1aa712-6349-4162-b2fa-e95257677c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:52.894911 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa712-6349-4162-b2fa-e95257677c79 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:52.899250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:52.899872 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:52.900146 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:52.900414 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] PATH_INFO: `/v3/users/6832971a34de4eb39981c57152c7c5ae` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:52.901543 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6832971a34de4eb39981c57152c7c5ae)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:52.903628 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:52.949711 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6832971a34de4eb39981c57152c7c5ae'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:52.950361 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6832971a34de4eb39981c57152c7c5ae'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:52.963593 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6832971a34de4eb39981c57152c7c5ae'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:52.971229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6832971a34de4eb39981c57152c7c5ae'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:52.971844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6832971a34de4eb39981c57152c7c5ae'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:52.990156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1403/2795] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:52 2022] DELETE /identity/v3/users/6832971a34de4eb39981c57152c7c5ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:53.175335 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91ea7-b30c-4530-8f2c-83ae31f0bd21 service swift] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:53.186623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91ea7-b30c-4530-8f2c-83ae31f0bd21 service swift] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:53.195819 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:53.249682 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:53.250319 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:53.250599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:53.250910 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] PATH_INFO: `/v3/projects/f250e6aabfe24dffa9249ad9f3512a50` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:53.252043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f250e6aabfe24dffa9249ad9f3512a50)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:53.253942 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:53.302258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f250e6aabfe24dffa9249ad9f3512a50', 'request_id': 'req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.308848 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f250e6aabfe24dffa9249ad9f3512a50', 'request_id': 'req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.316350 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f250e6aabfe24dffa9249ad9f3512a50', 'request_id': 'req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.327598 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] The token cache is being invalidate because project f250e6aabfe24dffa9249ad9f3512a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:53.327891 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.328529 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.330043 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1393/2796] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:53 2022] DELETE /identity/v3/projects/f250e6aabfe24dffa9249ad9f3512a50 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:53.334208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:53.335669 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:53.349505 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f524ef8-4362-4191-90c8-b30680487d44 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:53.381574 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:53.409408 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:53.410040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:53.410345 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:53.410621 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] PATH_INFO: `/v3/users/3354254906d646ccbec320ec63d003b8` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:53.411837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3354254906d646ccbec320ec63d003b8)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:53.413817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:53.468356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3354254906d646ccbec320ec63d003b8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.469001 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3354254906d646ccbec320ec63d003b8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.481248 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3354254906d646ccbec320ec63d003b8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.488038 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3354254906d646ccbec320ec63d003b8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.488639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-ac3edbff-cd50-46f9-a3f8-641ca250fc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3354254906d646ccbec320ec63d003b8'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.501339 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1404/2797] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:53 2022] DELETE /identity/v3/users/3354254906d646ccbec320ec63d003b8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:53.679584 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:53.681119 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:53.698320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fb51f-b923-43b9-ae6d-09b81d471a3b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:53.759725 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:53.760357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:53.760637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:53.760912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] PATH_INFO: `/v3/projects/8e4902559dbd4f0d8ec8cff760af6808` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:53.762554 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4902559dbd4f0d8ec8cff760af6808)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:53.764545 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:53.806749 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:53.810653 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4902559dbd4f0d8ec8cff760af6808', 'request_id': 'req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.817535 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4902559dbd4f0d8ec8cff760af6808', 'request_id': 'req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.825094 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4902559dbd4f0d8ec8cff760af6808', 'request_id': 'req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.835410 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] The token cache is being invalidate because project 8e4902559dbd4f0d8ec8cff760af6808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:53.835698 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.836337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:53.837818 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1394/2798] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:53 2022] DELETE /identity/v3/projects/8e4902559dbd4f0d8ec8cff760af6808 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:03.497809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:03.832357 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:03.692765 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd985f8-071d-4078-a7e7-96474405d0d8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:03.693305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd985f8-071d-4078-a7e7-96474405d0d8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:03.693305 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd985f8-071d-4078-a7e7-96474405d0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:03.713015 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-bbd985f8-071d-4078-a7e7-96474405d0d8 None None] MFA Rules not processed for user `0225a9543da6435bb0e87f1a764d0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:03.714886 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-bbd985f8-071d-4078-a7e7-96474405d0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:03.768877 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1405/2799] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:04.089333 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:04.090844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:04.173199 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cbbc9-d7b4-42db-b68e-e6aab1f8cc95 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:04.176953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:04.177563 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:04.177844 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:04.178120 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:04.179924 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:04.190793 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:04.192236 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:04.201450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1395/2800] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:13.762381 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=25 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:14.196646 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=35 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:54.880973 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd985f8-071d-4078-a7e7-96474405d0d8 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:54.882404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-bbd985f8-071d-4078-a7e7-96474405d0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:54.965857 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd985f8-071d-4078-a7e7-96474405d0d8 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:54.969689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:54.970289 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:54.970562 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:54.970854 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:54.972570 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:55.056440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:55.057863 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:55.077866 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1406/2801] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:57:57.978833 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:57.981239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:57.992701 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29585-2d53-48ee-a4ff-71b11ed27002 service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:57.997264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b0d4-2ec6-4dd7-972c-7ea3443a4fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:57.997849 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b0d4-2ec6-4dd7-972c-7ea3443a4fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:57.998131 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b0d4-2ec6-4dd7-972c-7ea3443a4fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:57.998394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b0d4-2ec6-4dd7-972c-7ea3443a4fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:58.000491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e579b0d4-2ec6-4dd7-972c-7ea3443a4fb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:58.014754 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579b0d4-2ec6-4dd7-972c-7ea3443a4fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:58.016201 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579b0d4-2ec6-4dd7-972c-7ea3443a4fb0 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:58.027837 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1396/2802] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:05.075356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=72 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:08.022355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:14.745422 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:14.746897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:14.812934 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc11ee6-e8fa-4361-891c-5b62ec8f5906 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:14.817384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:14.818004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:14.818278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:14.818546 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] PATH_INFO: `/v3/users/0225a9543da6435bb0e87f1a764d0f50` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:14.819679 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0225a9543da6435bb0e87f1a764d0f50)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:14.821568 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:14.872166 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0225a9543da6435bb0e87f1a764d0f50'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:14.872841 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0225a9543da6435bb0e87f1a764d0f50'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:14.889779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0225a9543da6435bb0e87f1a764d0f50'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:14.897279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0225a9543da6435bb0e87f1a764d0f50'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:14.897894 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-8f3112c4-7acf-496c-a2ab-6bb22b897fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0225a9543da6435bb0e87f1a764d0f50'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:14.910950 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1407/2803] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:58:14 2022] DELETE /identity/v3/users/0225a9543da6435bb0e87f1a764d0f50 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:15.105472 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b0d4-2ec6-4dd7-972c-7ea3443a4fb0 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.117651 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b0d4-2ec6-4dd7-972c-7ea3443a4fb0 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:15.181801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:15.182442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.182807 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.183024 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] PATH_INFO: `/v3/projects/58e80f05fe4844b2ad517d1d721d2498` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.184142 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e80f05fe4844b2ad517d1d721d2498)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:15.186072 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:15.237783 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e80f05fe4844b2ad517d1d721d2498', 'request_id': 'req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:15.243976 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e80f05fe4844b2ad517d1d721d2498', 'request_id': 'req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:15.252239 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e80f05fe4844b2ad517d1d721d2498', 'request_id': 'req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:15.266726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] The token cache is being invalidate because project 58e80f05fe4844b2ad517d1d721d2498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:58:15.267048 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:15.267707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e28916af-bc38-41cc-87a7-1f6d2fb16bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:15.269192 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1397/2804] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:58:15 2022] DELETE /identity/v3/projects/58e80f05fe4844b2ad517d1d721d2498 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:58:15.274121 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce2f5e-d6ca-4dc3-902e-68083de04ac5 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.274476 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce2f5e-d6ca-4dc3-902e-68083de04ac5 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.274881 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce2f5e-d6ca-4dc3-902e-68083de04ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.333084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-4dce2f5e-d6ca-4dc3-902e-68083de04ac5 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:15.334291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-4dce2f5e-d6ca-4dc3-902e-68083de04ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:15.378341 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:15.396897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1408/2805] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:15.405067 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16853-bc27-4e76-ba54-c366639ccb25 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.405355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16853-bc27-4e76-ba54-c366639ccb25 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.405632 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16853-bc27-4e76-ba54-c366639ccb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.426083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a1b16853-bc27-4e76-ba54-c366639ccb25 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:15.427331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a1b16853-bc27-4e76-ba54-c366639ccb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:15.436007 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1398/2806] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:15.440455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce2f5e-d6ca-4dc3-902e-68083de04ac5 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.451979 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce2f5e-d6ca-4dc3-902e-68083de04ac5 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:15.456744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0df23-789d-48e7-ace4-24424cf96a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:15.457346 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0df23-789d-48e7-ace4-24424cf96a0b admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.457626 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0df23-789d-48e7-ace4-24424cf96a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.457895 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0df23-789d-48e7-ace4-24424cf96a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.458550 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0df23-789d-48e7-ace4-24424cf96a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:58:15.458907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0df23-789d-48e7-ace4-24424cf96a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:15.460549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0df23-789d-48e7-ace4-24424cf96a0b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:15.472897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1409/2807] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:58:15.477283 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b16853-bc27-4e76-ba54-c366639ccb25 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.486662 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b16853-bc27-4e76-ba54-c366639ccb25 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:15.491386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faff34a-d7d8-4023-9d91-fc35b536e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:15.491953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faff34a-d7d8-4023-9d91-fc35b536e65f admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.492226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faff34a-d7d8-4023-9d91-fc35b536e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.492498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faff34a-d7d8-4023-9d91-fc35b536e65f admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.493112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faff34a-d7d8-4023-9d91-fc35b536e65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:15.495691 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faff34a-d7d8-4023-9d91-fc35b536e65f admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:15.532537 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1399/2808] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:58:15 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:15.536868 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0df23-789d-48e7-ace4-24424cf96a0b admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.547942 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0df23-789d-48e7-ace4-24424cf96a0b admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:15.608295 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f722570-da6b-4606-87fb-e2d9143b3ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:15.608907 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f722570-da6b-4606-87fb-e2d9143b3ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.609186 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f722570-da6b-4606-87fb-e2d9143b3ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.609461 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f722570-da6b-4606-87fb-e2d9143b3ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.610105 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f722570-da6b-4606-87fb-e2d9143b3ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:15.612071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f722570-da6b-4606-87fb-e2d9143b3ce1 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:15.634605 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1410/2809] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:58:15 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:15.639180 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faff34a-d7d8-4023-9d91-fc35b536e65f admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.650892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faff34a-d7d8-4023-9d91-fc35b536e65f admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:15.655771 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16e038-6260-4b65-aeda-b91a0af36964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:15.656411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16e038-6260-4b65-aeda-b91a0af36964 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.656694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16e038-6260-4b65-aeda-b91a0af36964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.657136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16e038-6260-4b65-aeda-b91a0af36964 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.657791 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16e038-6260-4b65-aeda-b91a0af36964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:15.659601 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16e038-6260-4b65-aeda-b91a0af36964 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:15.670411 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1400/2810] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:15.674420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f722570-da6b-4606-87fb-e2d9143b3ce1 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.685475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f722570-da6b-4606-87fb-e2d9143b3ce1 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:15.690133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9e867-4d12-4cdc-adc1-e33ef7581eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:15.690728 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9e867-4d12-4cdc-adc1-e33ef7581eaf admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.691039 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9e867-4d12-4cdc-adc1-e33ef7581eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.691315 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9e867-4d12-4cdc-adc1-e33ef7581eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.691955 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9e867-4d12-4cdc-adc1-e33ef7581eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:15.693544 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9e867-4d12-4cdc-adc1-e33ef7581eaf admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:15.704796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1411/2811] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:15.708967 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16e038-6260-4b65-aeda-b91a0af36964 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.719189 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16e038-6260-4b65-aeda-b91a0af36964 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:15.723960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7884ba-8b9b-4967-afff-9312edef1993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:15.724606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7884ba-8b9b-4967-afff-9312edef1993 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.724888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7884ba-8b9b-4967-afff-9312edef1993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.725162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7884ba-8b9b-4967-afff-9312edef1993 admin admin] PATH_INFO: `/v3/projects/fe9cd5c5083e4273b2a6bf7a92cd1759/users/0df6a47bb16240a6a1f641e5fc3288b6/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.740815 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7884ba-8b9b-4967-afff-9312edef1993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9cd5c5083e4273b2a6bf7a92cd1759, user_id=0df6a47bb16240a6a1f641e5fc3288b6, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:15.743555 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7884ba-8b9b-4967-afff-9312edef1993 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:15.759170 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1401/2812] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:58:15 2022] PUT /identity/v3/projects/fe9cd5c5083e4273b2a6bf7a92cd1759/users/0df6a47bb16240a6a1f641e5fc3288b6/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:15.769781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21231629-91fb-4e76-b018-50a4ef5c1c6b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.770265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21231629-91fb-4e76-b018-50a4ef5c1c6b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.770364 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21231629-91fb-4e76-b018-50a4ef5c1c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.799675 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-21231629-91fb-4e76-b018-50a4ef5c1c6b None None] MFA Rules not processed for user `0df6a47bb16240a6a1f641e5fc3288b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:15.801048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-21231629-91fb-4e76-b018-50a4ef5c1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:15.868321 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1412/2813] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:15.873386 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7884ba-8b9b-4967-afff-9312edef1993 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.895809 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:15.943835 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7884ba-8b9b-4967-afff-9312edef1993 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:15.949613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557b050-851d-47f1-8c27-8b284ca03708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:15.950264 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557b050-851d-47f1-8c27-8b284ca03708 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.950583 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557b050-851d-47f1-8c27-8b284ca03708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.950965 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557b050-851d-47f1-8c27-8b284ca03708 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.951595 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557b050-851d-47f1-8c27-8b284ca03708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:15.953518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557b050-851d-47f1-8c27-8b284ca03708 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:15.982157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1402/2814] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:58:15 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:15.986475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21231629-91fb-4e76-b018-50a4ef5c1c6b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.998664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21231629-91fb-4e76-b018-50a4ef5c1c6b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:16.041136 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:16.058176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98ed3-5077-4801-8bb2-5d40acc2ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:16.058812 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98ed3-5077-4801-8bb2-5d40acc2ea06 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:16.059095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98ed3-5077-4801-8bb2-5d40acc2ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:16.059366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98ed3-5077-4801-8bb2-5d40acc2ea06 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:16.059983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e98ed3-5077-4801-8bb2-5d40acc2ea06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:16.061888 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e98ed3-5077-4801-8bb2-5d40acc2ea06 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:16.083896 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1413/2815] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:58:15 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:16.088071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557b050-851d-47f1-8c27-8b284ca03708 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:16.098531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557b050-851d-47f1-8c27-8b284ca03708 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:16.103134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6f603-31a8-46b6-ba6e-b64a310ac7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:16.103732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f603-31a8-46b6-ba6e-b64a310ac7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:16.104006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f603-31a8-46b6-ba6e-b64a310ac7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:16.104276 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f603-31a8-46b6-ba6e-b64a310ac7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:16.104940 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6f603-31a8-46b6-ba6e-b64a310ac7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:16.106522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6f603-31a8-46b6-ba6e-b64a310ac7f8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:16.117258 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1403/2816] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:16.122065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98ed3-5077-4801-8bb2-5d40acc2ea06 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:16.132233 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98ed3-5077-4801-8bb2-5d40acc2ea06 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:16.137231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2c0fb-d6e8-462e-a787-23dff12dde95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:16.137873 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2c0fb-d6e8-462e-a787-23dff12dde95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:16.138151 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2c0fb-d6e8-462e-a787-23dff12dde95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:16.138424 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2c0fb-d6e8-462e-a787-23dff12dde95 admin admin] PATH_INFO: `/v3/projects/107961e462254d7aa56736b8078bfc47/users/cead55edd9b44b148d3d1a934972b8d2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:16.153572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2c0fb-d6e8-462e-a787-23dff12dde95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107961e462254d7aa56736b8078bfc47, user_id=cead55edd9b44b148d3d1a934972b8d2, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:16.156286 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2c0fb-d6e8-462e-a787-23dff12dde95 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:16.169475 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1414/2817] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:58:16 2022] PUT /identity/v3/projects/107961e462254d7aa56736b8078bfc47/users/cead55edd9b44b148d3d1a934972b8d2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:16.173365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6f603-31a8-46b6-ba6e-b64a310ac7f8 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:16.184028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6f603-31a8-46b6-ba6e-b64a310ac7f8 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:16.241656 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241abbe-315c-4883-affb-a03caf73d64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:16.242269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241abbe-315c-4883-affb-a03caf73d64a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:16.242550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241abbe-315c-4883-affb-a03caf73d64a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:16.242857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241abbe-315c-4883-affb-a03caf73d64a admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:16.243499 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241abbe-315c-4883-affb-a03caf73d64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:16.245741 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241abbe-315c-4883-affb-a03caf73d64a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:16.255745 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1404/2818] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:16.260860 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2c0fb-d6e8-462e-a787-23dff12dde95 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:16.271139 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2c0fb-d6e8-462e-a787-23dff12dde95 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:16.276724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a60ba-e974-4d38-83c1-c2f708ea9aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:16.277538 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a60ba-e974-4d38-83c1-c2f708ea9aac admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:16.277819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a60ba-e974-4d38-83c1-c2f708ea9aac admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:16.278092 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a60ba-e974-4d38-83c1-c2f708ea9aac admin admin] PATH_INFO: `/v3/projects/107961e462254d7aa56736b8078bfc47/users/cead55edd9b44b148d3d1a934972b8d2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:16.280045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a60ba-e974-4d38-83c1-c2f708ea9aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=107961e462254d7aa56736b8078bfc47, user_id=cead55edd9b44b148d3d1a934972b8d2, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:16.282629 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a60ba-e974-4d38-83c1-c2f708ea9aac admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:16.293493 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1415/2819] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:58:16 2022] PUT /identity/v3/projects/107961e462254d7aa56736b8078bfc47/users/cead55edd9b44b148d3d1a934972b8d2/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:58:16.304817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1decc2-ca1a-4dad-b2cb-12627fc33c2d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:16.305100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1decc2-ca1a-4dad-b2cb-12627fc33c2d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:16.305374 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1decc2-ca1a-4dad-b2cb-12627fc33c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:16.332278 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8e1decc2-ca1a-4dad-b2cb-12627fc33c2d None None] MFA Rules not processed for user `cead55edd9b44b148d3d1a934972b8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:16.333474 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8e1decc2-ca1a-4dad-b2cb-12627fc33c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:16.404018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1405/2820] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:16.415356 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a60ba-e974-4d38-83c1-c2f708ea9aac admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:16.417119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-803a60ba-e974-4d38-83c1-c2f708ea9aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:16.475255 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a60ba-e974-4d38-83c1-c2f708ea9aac admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:16.479557 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda91e-6e10-4f3a-983f-3850cb835bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:16.480426 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda91e-6e10-4f3a-983f-3850cb835bdd service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:16.480706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda91e-6e10-4f3a-983f-3850cb835bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:16.480982 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda91e-6e10-4f3a-983f-3850cb835bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:16.490882 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cda91e-6e10-4f3a-983f-3850cb835bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:16.492318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cda91e-6e10-4f3a-983f-3850cb835bdd service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:16.502995 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1416/2821] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:16.548633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1decc2-ca1a-4dad-b2cb-12627fc33c2d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:16.550136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8e1decc2-ca1a-4dad-b2cb-12627fc33c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:16.563732 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1decc2-ca1a-4dad-b2cb-12627fc33c2d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:16.567435 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617245a-b656-4489-9727-140c0769a707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:16.568042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617245a-b656-4489-9727-140c0769a707 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:16.568321 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617245a-b656-4489-9727-140c0769a707 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:16.568591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617245a-b656-4489-9727-140c0769a707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:16.579147 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:16.628767 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617245a-b656-4489-9727-140c0769a707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:16.630210 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617245a-b656-4489-9727-140c0769a707 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:16.640028 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1406/2822] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:19.968770 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda91e-6e10-4f3a-983f-3850cb835bdd service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:20.033887 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda91e-6e10-4f3a-983f-3850cb835bdd service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:20.038412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:20.039084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:20.039366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:20.039639 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] PATH_INFO: `/v3/users/0df6a47bb16240a6a1f641e5fc3288b6` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:20.040789 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df6a47bb16240a6a1f641e5fc3288b6)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:20.043491 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:20.084456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:20.091963 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df6a47bb16240a6a1f641e5fc3288b6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.092901 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df6a47bb16240a6a1f641e5fc3288b6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.106511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df6a47bb16240a6a1f641e5fc3288b6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.113838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df6a47bb16240a6a1f641e5fc3288b6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.114484 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df6a47bb16240a6a1f641e5fc3288b6'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.126802 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1417/2823] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:58:19 2022] DELETE /identity/v3/users/0df6a47bb16240a6a1f641e5fc3288b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:20.131396 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2e331-3f9c-4c31-ac78-20dfb7dd22f9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:20.131881 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2e331-3f9c-4c31-ac78-20dfb7dd22f9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:20.131994 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2e331-3f9c-4c31-ac78-20dfb7dd22f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:20.152124 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-18f2e331-3f9c-4c31-ac78-20dfb7dd22f9 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:20.153338 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-18f2e331-3f9c-4c31-ac78-20dfb7dd22f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:20.211672 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1407/2824] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:20.221945 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:20.223387 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:20.282910 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab23e-5384-4a3c-b96f-73ca424aaed9 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:20.286596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ed89-9b80-4b30-8c3e-69ef48e5c3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:20.287224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ed89-9b80-4b30-8c3e-69ef48e5c3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:20.287507 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ed89-9b80-4b30-8c3e-69ef48e5c3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:20.287781 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ed89-9b80-4b30-8c3e-69ef48e5c3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:20.297358 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79ed89-9b80-4b30-8c3e-69ef48e5c3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:20.298811 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79ed89-9b80-4b30-8c3e-69ef48e5c3b2 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:20.308783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1418/2825] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:20.586906 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2e331-3f9c-4c31-ac78-20dfb7dd22f9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:20.588384 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-18f2e331-3f9c-4c31-ac78-20dfb7dd22f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:20.602495 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2e331-3f9c-4c31-ac78-20dfb7dd22f9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:20.607088 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:20.607730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:20.608009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:20.608282 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] PATH_INFO: `/v3/projects/fe9cd5c5083e4273b2a6bf7a92cd1759` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:20.609405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9cd5c5083e4273b2a6bf7a92cd1759)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:20.612151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:20.661203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9cd5c5083e4273b2a6bf7a92cd1759', 'request_id': 'req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.667604 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9cd5c5083e4273b2a6bf7a92cd1759', 'request_id': 'req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.675371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9cd5c5083e4273b2a6bf7a92cd1759', 'request_id': 'req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.686719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] The token cache is being invalidate because project fe9cd5c5083e4273b2a6bf7a92cd1759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:58:20.687042 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.687674 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.689163 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1408/2826] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:58:20 2022] DELETE /identity/v3/projects/fe9cd5c5083e4273b2a6bf7a92cd1759 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:20.693177 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ed89-9b80-4b30-8c3e-69ef48e5c3b2 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:20.703983 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ed89-9b80-4b30-8c3e-69ef48e5c3b2 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:20.764046 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:20.764680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:20.764999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:20.765253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] PATH_INFO: `/v3/users/cead55edd9b44b148d3d1a934972b8d2` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:20.766441 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cead55edd9b44b148d3d1a934972b8d2)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:20.768378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:20.816357 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cead55edd9b44b148d3d1a934972b8d2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.816999 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cead55edd9b44b148d3d1a934972b8d2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.828734 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:20.829968 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cead55edd9b44b148d3d1a934972b8d2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.837749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cead55edd9b44b148d3d1a934972b8d2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.838655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-10eb7f8e-e289-426c-a817-3c9a6980e9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cead55edd9b44b148d3d1a934972b8d2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:20.854250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1419/2827] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:58:20 2022] DELETE /identity/v3/users/cead55edd9b44b148d3d1a934972b8d2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:21.141661 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:21.143490 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:21.158081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ddb9-6eba-4560-98e8-ff696f67d7b7 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:21.196659 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:21.223281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:21.223652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.223931 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.224209 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] PATH_INFO: `/v3/projects/107961e462254d7aa56736b8078bfc47` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.225337 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107961e462254d7aa56736b8078bfc47)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:21.227293 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:21.283517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107961e462254d7aa56736b8078bfc47', 'request_id': 'req-33815b54-4dff-4c4e-8725-ab3a728b8a39'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:21.292262 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107961e462254d7aa56736b8078bfc47', 'request_id': 'req-33815b54-4dff-4c4e-8725-ab3a728b8a39'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:21.300694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107961e462254d7aa56736b8078bfc47', 'request_id': 'req-33815b54-4dff-4c4e-8725-ab3a728b8a39'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:21.311804 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] The token cache is being invalidate because project 107961e462254d7aa56736b8078bfc47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:58:21.312091 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:21.312724 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-33815b54-4dff-4c4e-8725-ab3a728b8a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:21.314312 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1409/2828] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:58:21 2022] DELETE /identity/v3/projects/107961e462254d7aa56736b8078bfc47 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:21.319250 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a637-bf29-4857-8772-0fb459945712 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.319833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a637-bf29-4857-8772-0fb459945712 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.319833 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a637-bf29-4857-8772-0fb459945712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.340176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-6d86a637-bf29-4857-8772-0fb459945712 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:21.341412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6d86a637-bf29-4857-8772-0fb459945712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:21.402327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1420/2829] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:21.410195 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1857-91cb-4196-98ff-c37ce6899d1c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.410550 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1857-91cb-4196-98ff-c37ce6899d1c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.410930 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1857-91cb-4196-98ff-c37ce6899d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.430989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f86d1857-91cb-4196-98ff-c37ce6899d1c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:21.432224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f86d1857-91cb-4196-98ff-c37ce6899d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:21.440025 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1410/2830] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:21.444314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86a637-bf29-4857-8772-0fb459945712 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:21.454065 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86a637-bf29-4857-8772-0fb459945712 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:21.458616 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d81eb4-3f33-4222-ae16-dd324baacf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:21.459240 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d81eb4-3f33-4222-ae16-dd324baacf4f admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.459514 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d81eb4-3f33-4222-ae16-dd324baacf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.459785 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d81eb4-3f33-4222-ae16-dd324baacf4f admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.460425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d81eb4-3f33-4222-ae16-dd324baacf4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:58:21.460720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d81eb4-3f33-4222-ae16-dd324baacf4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:21.462298 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d81eb4-3f33-4222-ae16-dd324baacf4f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:21.474432 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1421/2831] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:58:21.479721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d1857-91cb-4196-98ff-c37ce6899d1c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:21.488958 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d1857-91cb-4196-98ff-c37ce6899d1c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:21.493648 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da7dcd-470a-4331-aae0-e86ccbad8eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:21.494277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da7dcd-470a-4331-aae0-e86ccbad8eed admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.494676 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da7dcd-470a-4331-aae0-e86ccbad8eed admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.494991 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da7dcd-470a-4331-aae0-e86ccbad8eed admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.495619 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da7dcd-470a-4331-aae0-e86ccbad8eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:21.497509 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da7dcd-470a-4331-aae0-e86ccbad8eed admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:21.524515 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1411/2832] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:58:21 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:58:21.529191 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d81eb4-3f33-4222-ae16-dd324baacf4f admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:21.539249 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d81eb4-3f33-4222-ae16-dd324baacf4f admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:21.602708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7673a29-132e-416f-b113-38944220d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:21.603348 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7673a29-132e-416f-b113-38944220d11a admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.603630 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7673a29-132e-416f-b113-38944220d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.604561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7673a29-132e-416f-b113-38944220d11a admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.605205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7673a29-132e-416f-b113-38944220d11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:21.607133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7673a29-132e-416f-b113-38944220d11a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:21.628144 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1422/2833] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:58:21 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:21.632351 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da7dcd-470a-4331-aae0-e86ccbad8eed admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:21.644269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da7dcd-470a-4331-aae0-e86ccbad8eed admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:21.648968 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6fd3b-f504-4f51-887b-f38c39081d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:21.649570 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6fd3b-f504-4f51-887b-f38c39081d4a admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.649874 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6fd3b-f504-4f51-887b-f38c39081d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.650273 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6fd3b-f504-4f51-887b-f38c39081d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.651453 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6fd3b-f504-4f51-887b-f38c39081d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:21.653047 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6fd3b-f504-4f51-887b-f38c39081d4a admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:21.663075 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1412/2834] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:21.667117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7673a29-132e-416f-b113-38944220d11a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:21.677266 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7673a29-132e-416f-b113-38944220d11a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:21.681941 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876a460-8408-46ca-ad11-362e379273e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:21.682738 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876a460-8408-46ca-ad11-362e379273e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.683054 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876a460-8408-46ca-ad11-362e379273e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.683327 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876a460-8408-46ca-ad11-362e379273e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.683993 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876a460-8408-46ca-ad11-362e379273e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:21.685571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876a460-8408-46ca-ad11-362e379273e7 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:21.696101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1423/2835] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:58:21.701340 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6fd3b-f504-4f51-887b-f38c39081d4a admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:21.711505 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6fd3b-f504-4f51-887b-f38c39081d4a admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:21.716759 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc819-0a9e-4d6b-ab5f-a3e064ebf9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:21.717409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc819-0a9e-4d6b-ab5f-a3e064ebf9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.717693 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc819-0a9e-4d6b-ab5f-a3e064ebf9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.717969 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc819-0a9e-4d6b-ab5f-a3e064ebf9a4 admin admin] PATH_INFO: `/v3/projects/c497a7a63c824cfc8d141ea267dd8ec8/users/b20f3b90858a4316adf0df9d3c71d54d/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.733269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cc819-0a9e-4d6b-ab5f-a3e064ebf9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c497a7a63c824cfc8d141ea267dd8ec8, user_id=b20f3b90858a4316adf0df9d3c71d54d, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:21.736159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cc819-0a9e-4d6b-ab5f-a3e064ebf9a4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:21.750481 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1413/2836] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:58:21 2022] PUT /identity/v3/projects/c497a7a63c824cfc8d141ea267dd8ec8/users/b20f3b90858a4316adf0df9d3c71d54d/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:21.762471 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ad9f-9198-42b0-9944-6d04b3f664cd None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.762757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ad9f-9198-42b0-9944-6d04b3f664cd None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.763064 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ad9f-9198-42b0-9944-6d04b3f664cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.790283 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-6a49ad9f-9198-42b0-9944-6d04b3f664cd None None] MFA Rules not processed for user `b20f3b90858a4316adf0df9d3c71d54d`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:21.791971 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-6a49ad9f-9198-42b0-9944-6d04b3f664cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:21.826744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:21.863717 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1424/2837] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:21.868207 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc819-0a9e-4d6b-ab5f-a3e064ebf9a4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:21.934387 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc819-0a9e-4d6b-ab5f-a3e064ebf9a4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:21.939597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6be2d5-b05d-4e2b-b60c-8e49b3aaa2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:21.940240 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6be2d5-b05d-4e2b-b60c-8e49b3aaa2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.940519 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6be2d5-b05d-4e2b-b60c-8e49b3aaa2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.940792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6be2d5-b05d-4e2b-b60c-8e49b3aaa2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.941426 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6be2d5-b05d-4e2b-b60c-8e49b3aaa2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:21.943402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6be2d5-b05d-4e2b-b60c-8e49b3aaa2c3 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:21.949318 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:21.973762 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1414/2838] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:58:21 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:21.977784 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ad9f-9198-42b0-9944-6d04b3f664cd None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:21.989164 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ad9f-9198-42b0-9944-6d04b3f664cd None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:22.047598 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e501c-86e5-4429-8d95-c9fb8a163730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:22.048218 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e501c-86e5-4429-8d95-c9fb8a163730 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:22.048495 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e501c-86e5-4429-8d95-c9fb8a163730 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:22.048798 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e501c-86e5-4429-8d95-c9fb8a163730 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:22.049384 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e501c-86e5-4429-8d95-c9fb8a163730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:22.051343 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e501c-86e5-4429-8d95-c9fb8a163730 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:22.072733 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1425/2839] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:58:21 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:22.077320 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6be2d5-b05d-4e2b-b60c-8e49b3aaa2c3 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:22.087938 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6be2d5-b05d-4e2b-b60c-8e49b3aaa2c3 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:22.093140 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7e6e-a296-47d1-a46d-c75e89db3cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:22.093746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7e6e-a296-47d1-a46d-c75e89db3cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:22.094027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7e6e-a296-47d1-a46d-c75e89db3cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:22.094298 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7e6e-a296-47d1-a46d-c75e89db3cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:22.094974 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba7e6e-a296-47d1-a46d-c75e89db3cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:22.096580 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba7e6e-a296-47d1-a46d-c75e89db3cd9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:22.107226 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1415/2840] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:22.111406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e501c-86e5-4429-8d95-c9fb8a163730 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:22.121953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e501c-86e5-4429-8d95-c9fb8a163730 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:22.126691 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4fd04-cd98-4a67-96b6-2d12bce4aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:22.127412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4fd04-cd98-4a67-96b6-2d12bce4aed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:22.127751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4fd04-cd98-4a67-96b6-2d12bce4aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:22.128009 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4fd04-cd98-4a67-96b6-2d12bce4aed8 admin admin] PATH_INFO: `/v3/projects/9e5246654e5a48c9a75d7a1d303a8782/users/467768c7b2d0406b81d8532f57026e06/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:22.143685 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4fd04-cd98-4a67-96b6-2d12bce4aed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5246654e5a48c9a75d7a1d303a8782, user_id=467768c7b2d0406b81d8532f57026e06, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:22.146497 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4fd04-cd98-4a67-96b6-2d12bce4aed8 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:22.160467 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1426/2841] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:58:22 2022] PUT /identity/v3/projects/9e5246654e5a48c9a75d7a1d303a8782/users/467768c7b2d0406b81d8532f57026e06/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:22.164569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7e6e-a296-47d1-a46d-c75e89db3cd9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:22.175851 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7e6e-a296-47d1-a46d-c75e89db3cd9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:22.236269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226191a-956f-4623-ab0e-cc03e7b6e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:22.236888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226191a-956f-4623-ab0e-cc03e7b6e838 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:22.237184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226191a-956f-4623-ab0e-cc03e7b6e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:22.237458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226191a-956f-4623-ab0e-cc03e7b6e838 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:22.238102 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226191a-956f-4623-ab0e-cc03e7b6e838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:22.239811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226191a-956f-4623-ab0e-cc03e7b6e838 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:22.250315 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1416/2842] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:22.254698 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4fd04-cd98-4a67-96b6-2d12bce4aed8 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:22.265561 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4fd04-cd98-4a67-96b6-2d12bce4aed8 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:22.270085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128e165-82fb-4889-9398-8946cbe034d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:22.270732 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e165-82fb-4889-9398-8946cbe034d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:22.271044 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e165-82fb-4889-9398-8946cbe034d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:22.271319 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e165-82fb-4889-9398-8946cbe034d8 admin admin] PATH_INFO: `/v3/projects/9e5246654e5a48c9a75d7a1d303a8782/users/467768c7b2d0406b81d8532f57026e06/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:22.273235 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128e165-82fb-4889-9398-8946cbe034d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5246654e5a48c9a75d7a1d303a8782, user_id=467768c7b2d0406b81d8532f57026e06, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:22.276409 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128e165-82fb-4889-9398-8946cbe034d8 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:22.286509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1427/2843] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:58:22 2022] PUT /identity/v3/projects/9e5246654e5a48c9a75d7a1d303a8782/users/467768c7b2d0406b81d8532f57026e06/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:22.297451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f63946-21f0-4dab-889c-022d53d3382a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:22.297787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f63946-21f0-4dab-889c-022d53d3382a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:22.298006 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f63946-21f0-4dab-889c-022d53d3382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:22.326652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c9f63946-21f0-4dab-889c-022d53d3382a None None] MFA Rules not processed for user `467768c7b2d0406b81d8532f57026e06`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:22.327962 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c9f63946-21f0-4dab-889c-022d53d3382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:22.403648 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1417/2844] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:22.414395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128e165-82fb-4889-9398-8946cbe034d8 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:22.416187 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-e128e165-82fb-4889-9398-8946cbe034d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:22.473831 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128e165-82fb-4889-9398-8946cbe034d8 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:22.477435 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dd8ed-daba-41dd-b006-f9c1049d3c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:22.478031 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dd8ed-daba-41dd-b006-f9c1049d3c93 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:22.478307 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dd8ed-daba-41dd-b006-f9c1049d3c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:22.478600 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dd8ed-daba-41dd-b006-f9c1049d3c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:22.487641 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dd8ed-daba-41dd-b006-f9c1049d3c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:22.489043 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dd8ed-daba-41dd-b006-f9c1049d3c93 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:22.498407 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1428/2845] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:22.546069 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f63946-21f0-4dab-889c-022d53d3382a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:22.547531 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c9f63946-21f0-4dab-889c-022d53d3382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:22.560623 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f63946-21f0-4dab-889c-022d53d3382a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:22.564269 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5bf89-0446-4332-a14b-14f3da8d0aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:22.564882 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5bf89-0446-4332-a14b-14f3da8d0aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:22.565169 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5bf89-0446-4332-a14b-14f3da8d0aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:22.565438 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5bf89-0446-4332-a14b-14f3da8d0aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:22.625957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:22.628491 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5bf89-0446-4332-a14b-14f3da8d0aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:22.629956 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5bf89-0446-4332-a14b-14f3da8d0aa2 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:22.641504 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1418/2846] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:25.982101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dd8ed-daba-41dd-b006-f9c1049d3c93 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:26.016169 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:26.046920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dd8ed-daba-41dd-b006-f9c1049d3c93 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:26.051553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:26.052190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:26.052451 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:26.052720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] PATH_INFO: `/v3/users/b20f3b90858a4316adf0df9d3c71d54d` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:26.053824 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20f3b90858a4316adf0df9d3c71d54d)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:26.055767 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:26.106137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20f3b90858a4316adf0df9d3c71d54d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.106829 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20f3b90858a4316adf0df9d3c71d54d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.118954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20f3b90858a4316adf0df9d3c71d54d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.127710 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20f3b90858a4316adf0df9d3c71d54d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.128613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20f3b90858a4316adf0df9d3c71d54d'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.141613 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1429/2847] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:58:25 2022] DELETE /identity/v3/users/b20f3b90858a4316adf0df9d3c71d54d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:26.146118 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199bb43-b001-4e91-897c-4f03bea06cc9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:26.146597 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199bb43-b001-4e91-897c-4f03bea06cc9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:26.146726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199bb43-b001-4e91-897c-4f03bea06cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:26.167498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b199bb43-b001-4e91-897c-4f03bea06cc9 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:26.168694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b199bb43-b001-4e91-897c-4f03bea06cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:26.229064 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1419/2848] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:26.238834 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:26.240244 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:26.297351 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae36eb-8352-4059-8a81-85094d29de1e admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:26.301022 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68e10-cf26-44fa-8b3c-c57ed8bf4b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:26.301622 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68e10-cf26-44fa-8b3c-c57ed8bf4b09 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:26.301897 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68e10-cf26-44fa-8b3c-c57ed8bf4b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:26.302167 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68e10-cf26-44fa-8b3c-c57ed8bf4b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:26.312083 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68e10-cf26-44fa-8b3c-c57ed8bf4b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:26.313532 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68e10-cf26-44fa-8b3c-c57ed8bf4b09 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:26.323182 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1430/2849] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:26.590999 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199bb43-b001-4e91-897c-4f03bea06cc9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:26.592441 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b199bb43-b001-4e91-897c-4f03bea06cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:26.607983 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199bb43-b001-4e91-897c-4f03bea06cc9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:26.613949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:26.614685 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:26.615070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:26.615470 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] PATH_INFO: `/v3/projects/c497a7a63c824cfc8d141ea267dd8ec8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:26.616929 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c497a7a63c824cfc8d141ea267dd8ec8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:26.619326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:26.668198 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c497a7a63c824cfc8d141ea267dd8ec8', 'request_id': 'req-e42a9ccd-bde9-4994-a643-ca55739eb5bb'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.674517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c497a7a63c824cfc8d141ea267dd8ec8', 'request_id': 'req-e42a9ccd-bde9-4994-a643-ca55739eb5bb'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.682993 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c497a7a63c824cfc8d141ea267dd8ec8', 'request_id': 'req-e42a9ccd-bde9-4994-a643-ca55739eb5bb'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.693677 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] The token cache is being invalidate because project c497a7a63c824cfc8d141ea267dd8ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:58:26.693960 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.694668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.696222 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1420/2850] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:58:26 2022] DELETE /identity/v3/projects/c497a7a63c824cfc8d141ea267dd8ec8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:26.700392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68e10-cf26-44fa-8b3c-c57ed8bf4b09 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:26.710204 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68e10-cf26-44fa-8b3c-c57ed8bf4b09 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:26.758637 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:26.769486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:26.770048 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:26.770318 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:26.770584 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] PATH_INFO: `/v3/users/467768c7b2d0406b81d8532f57026e06` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:26.771714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=467768c7b2d0406b81d8532f57026e06)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:26.773664 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:26.822006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467768c7b2d0406b81d8532f57026e06'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.822690 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467768c7b2d0406b81d8532f57026e06'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.834444 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467768c7b2d0406b81d8532f57026e06'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.842572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467768c7b2d0406b81d8532f57026e06'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.843242 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-4eabe419-2a81-4214-bce2-d03f0e2a6161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467768c7b2d0406b81d8532f57026e06'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:26.856774 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1431/2851] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:58:26 2022] DELETE /identity/v3/users/467768c7b2d0406b81d8532f57026e06 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:27.133758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:27.136246 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:27.154368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a9ccd-bde9-4994-a643-ca55739eb5bb admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:27.216367 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:27.217004 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.217283 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.217560 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] PATH_INFO: `/v3/projects/9e5246654e5a48c9a75d7a1d303a8782` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.218719 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5246654e5a48c9a75d7a1d303a8782)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:27.220708 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:27.243355 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:27.269569 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5246654e5a48c9a75d7a1d303a8782', 'request_id': 'req-942a94b5-eac2-415f-91a1-789b48ab7fd2'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:27.275752 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5246654e5a48c9a75d7a1d303a8782', 'request_id': 'req-942a94b5-eac2-415f-91a1-789b48ab7fd2'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:27.284518 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5246654e5a48c9a75d7a1d303a8782', 'request_id': 'req-942a94b5-eac2-415f-91a1-789b48ab7fd2'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:27.295183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] The token cache is being invalidate because project 9e5246654e5a48c9a75d7a1d303a8782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:58:27.295496 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:27.296129 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-942a94b5-eac2-415f-91a1-789b48ab7fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:27.297613 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1421/2852] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:58:27 2022] DELETE /identity/v3/projects/9e5246654e5a48c9a75d7a1d303a8782 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:27.303531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b9c5c-2fa6-4de4-9d83-e34ea9787717 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.304017 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b9c5c-2fa6-4de4-9d83-e34ea9787717 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.304124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b9c5c-2fa6-4de4-9d83-e34ea9787717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.324536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-f65b9c5c-2fa6-4de4-9d83-e34ea9787717 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:27.325763 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f65b9c5c-2fa6-4de4-9d83-e34ea9787717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:27.383935 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1432/2853] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:27.392547 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c260e3-f11d-41cc-839a-85c1e79cc9d0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.392870 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c260e3-f11d-41cc-839a-85c1e79cc9d0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.393151 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c260e3-f11d-41cc-839a-85c1e79cc9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.413331 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c6c260e3-f11d-41cc-839a-85c1e79cc9d0 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:27.414551 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c6c260e3-f11d-41cc-839a-85c1e79cc9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:27.423203 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1422/2854] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:27.427705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b9c5c-2fa6-4de4-9d83-e34ea9787717 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:27.438331 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b9c5c-2fa6-4de4-9d83-e34ea9787717 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:27.442917 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181c920-8ac5-4f03-804a-96bb7ca9f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:27.443515 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181c920-8ac5-4f03-804a-96bb7ca9f3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.443796 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181c920-8ac5-4f03-804a-96bb7ca9f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.444069 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181c920-8ac5-4f03-804a-96bb7ca9f3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.444757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181c920-8ac5-4f03-804a-96bb7ca9f3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:58:27.445100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181c920-8ac5-4f03-804a-96bb7ca9f3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:27.446799 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181c920-8ac5-4f03-804a-96bb7ca9f3b9 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:27.459282 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1433/2855] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:58:27.463690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c260e3-f11d-41cc-839a-85c1e79cc9d0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:27.473005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c260e3-f11d-41cc-839a-85c1e79cc9d0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:27.477539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf83623-06f3-4967-b799-83d77626d8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:27.478128 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf83623-06f3-4967-b799-83d77626d8ee admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.478402 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf83623-06f3-4967-b799-83d77626d8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.478823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf83623-06f3-4967-b799-83d77626d8ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.479455 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf83623-06f3-4967-b799-83d77626d8ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:27.481339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf83623-06f3-4967-b799-83d77626d8ee admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:27.509447 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1423/2856] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:58:27 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:27.514680 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181c920-8ac5-4f03-804a-96bb7ca9f3b9 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:27.524954 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181c920-8ac5-4f03-804a-96bb7ca9f3b9 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:27.583844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944f526-6bb7-4bc5-a04c-60ad4d5e7080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:27.584370 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944f526-6bb7-4bc5-a04c-60ad4d5e7080 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.584642 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944f526-6bb7-4bc5-a04c-60ad4d5e7080 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.584913 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944f526-6bb7-4bc5-a04c-60ad4d5e7080 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.585531 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944f526-6bb7-4bc5-a04c-60ad4d5e7080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:27.587498 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944f526-6bb7-4bc5-a04c-60ad4d5e7080 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:27.595624 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:27.612718 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1434/2857] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:58:27 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:27.616892 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf83623-06f3-4967-b799-83d77626d8ee admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:27.628044 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf83623-06f3-4967-b799-83d77626d8ee admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:27.632686 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9224e-4bc6-4308-b4d4-3cbe4c07ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:27.633286 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9224e-4bc6-4308-b4d4-3cbe4c07ad1e admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.633565 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9224e-4bc6-4308-b4d4-3cbe4c07ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.633957 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9224e-4bc6-4308-b4d4-3cbe4c07ad1e admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.635021 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9224e-4bc6-4308-b4d4-3cbe4c07ad1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:27.636857 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9224e-4bc6-4308-b4d4-3cbe4c07ad1e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:27.646944 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1424/2858] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:27.651061 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944f526-6bb7-4bc5-a04c-60ad4d5e7080 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:27.661751 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944f526-6bb7-4bc5-a04c-60ad4d5e7080 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:27.668113 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c968d-c176-42fe-8ee2-5f4f2db4ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:27.668704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c968d-c176-42fe-8ee2-5f4f2db4ad98 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.668975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c968d-c176-42fe-8ee2-5f4f2db4ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.669419 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c968d-c176-42fe-8ee2-5f4f2db4ad98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.670068 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c968d-c176-42fe-8ee2-5f4f2db4ad98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:27.671909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c968d-c176-42fe-8ee2-5f4f2db4ad98 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:27.684592 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1435/2859] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:27.689162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9224e-4bc6-4308-b4d4-3cbe4c07ad1e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:27.699796 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9224e-4bc6-4308-b4d4-3cbe4c07ad1e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:27.704404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf41be-ea8b-453c-9bd3-b262174470fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:27.705051 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf41be-ea8b-453c-9bd3-b262174470fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.705328 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf41be-ea8b-453c-9bd3-b262174470fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.705599 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf41be-ea8b-453c-9bd3-b262174470fd admin admin] PATH_INFO: `/v3/projects/d1fb25384dde4f27b43b82726ccf9319/users/f387516864f949738922a55b875e3667/roles/b7551ed385954688a565792f95efda9c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.721412 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf41be-ea8b-453c-9bd3-b262174470fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1fb25384dde4f27b43b82726ccf9319, user_id=f387516864f949738922a55b875e3667, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:27.724108 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf41be-ea8b-453c-9bd3-b262174470fd admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:27.738101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1425/2860] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:58:27 2022] PUT /identity/v3/projects/d1fb25384dde4f27b43b82726ccf9319/users/f387516864f949738922a55b875e3667/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:27.743211 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3241a68-11bc-4dbe-bfa1-c0b093f1ff8c None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.743500 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3241a68-11bc-4dbe-bfa1-c0b093f1ff8c None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.743778 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3241a68-11bc-4dbe-bfa1-c0b093f1ff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.764625 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d3241a68-11bc-4dbe-bfa1-c0b093f1ff8c None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:27.765849 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d3241a68-11bc-4dbe-bfa1-c0b093f1ff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:27.826362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1436/2861] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:27.836105 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf41be-ea8b-453c-9bd3-b262174470fd admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:27.837774 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-94cf41be-ea8b-453c-9bd3-b262174470fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:27.898173 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf41be-ea8b-453c-9bd3-b262174470fd admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:27.902522 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ab66-363c-4f7d-ac10-3375cc13aafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:27.903171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ab66-363c-4f7d-ac10-3375cc13aafe service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.903454 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ab66-363c-4f7d-ac10-3375cc13aafe service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.903730 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ab66-363c-4f7d-ac10-3375cc13aafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.912702 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31ab66-363c-4f7d-ac10-3375cc13aafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:27.914134 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31ab66-363c-4f7d-ac10-3375cc13aafe service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:27.924705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1426/2862] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:28.621220 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ecebc-f60c-40a6-b823-064d03705664 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:28.621809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ecebc-f60c-40a6-b823-064d03705664 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:28.621996 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ecebc-f60c-40a6-b823-064d03705664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:28.663453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-3b9ecebc-f60c-40a6-b823-064d03705664 None None] MFA Rules not processed for user `f387516864f949738922a55b875e3667`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:28.664809 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-3b9ecebc-f60c-40a6-b823-064d03705664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:28.743076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1437/2863] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:28.748326 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ab66-363c-4f7d-ac10-3375cc13aafe service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:28.758098 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ab66-363c-4f7d-ac10-3375cc13aafe service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:28.763875 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a1419-3156-4b52-865e-0c42d22de9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:28.764483 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a1419-3156-4b52-865e-0c42d22de9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:28.764763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a1419-3156-4b52-865e-0c42d22de9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:28.765038 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a1419-3156-4b52-865e-0c42d22de9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:28.765671 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a1419-3156-4b52-865e-0c42d22de9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:28.767609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a1419-3156-4b52-865e-0c42d22de9d5 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:28.796776 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1427/2864] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:58:28 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:28.801224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ecebc-f60c-40a6-b823-064d03705664 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:28.812914 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ecebc-f60c-40a6-b823-064d03705664 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:28.873583 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83571a55-6ff4-4586-8102-748f45650856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:28.874201 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83571a55-6ff4-4586-8102-748f45650856 admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:28.874480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83571a55-6ff4-4586-8102-748f45650856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:28.874752 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83571a55-6ff4-4586-8102-748f45650856 admin admin] PATH_INFO: `/v3/users` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:28.875440 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83571a55-6ff4-4586-8102-748f45650856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:28.877404 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83571a55-6ff4-4586-8102-748f45650856 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:28.894938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:28.902518 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1438/2865] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:58:28 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:58:28.906405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a1419-3156-4b52-865e-0c42d22de9d5 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:28.916765 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a1419-3156-4b52-865e-0c42d22de9d5 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:28.921364 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcffbbd-a51f-4b9d-b5f6-6ae63698f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:28.921971 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcffbbd-a51f-4b9d-b5f6-6ae63698f726 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:28.922248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcffbbd-a51f-4b9d-b5f6-6ae63698f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:28.922517 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcffbbd-a51f-4b9d-b5f6-6ae63698f726 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:28.923225 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcffbbd-a51f-4b9d-b5f6-6ae63698f726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:28.924817 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcffbbd-a51f-4b9d-b5f6-6ae63698f726 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:28.936458 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1428/2866] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:28.940714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83571a55-6ff4-4586-8102-748f45650856 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:28.952137 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83571a55-6ff4-4586-8102-748f45650856 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:28.957085 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27170a-7048-4845-907f-1121d0cf3df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:28.958168 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27170a-7048-4845-907f-1121d0cf3df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:28.958378 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27170a-7048-4845-907f-1121d0cf3df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:28.958655 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27170a-7048-4845-907f-1121d0cf3df3 admin admin] PATH_INFO: `/v3/projects/3c6f1588a5434d3990c97a10dcfbaddd/users/bc43aa3f9d4f4f3a99170d91555ebd89/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:28.975147 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27170a-7048-4845-907f-1121d0cf3df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6f1588a5434d3990c97a10dcfbaddd, user_id=bc43aa3f9d4f4f3a99170d91555ebd89, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:28.977826 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27170a-7048-4845-907f-1121d0cf3df3 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:28.991745 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1439/2867] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:58:28 2022] PUT /identity/v3/projects/3c6f1588a5434d3990c97a10dcfbaddd/users/bc43aa3f9d4f4f3a99170d91555ebd89/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:28.997081 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcffbbd-a51f-4b9d-b5f6-6ae63698f726 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:29.007255 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcffbbd-a51f-4b9d-b5f6-6ae63698f726 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:29.020281 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:29.070079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56881ae5-4155-4ca5-9c49-d484cc10d914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:29.070694 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881ae5-4155-4ca5-9c49-d484cc10d914 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:29.071002 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881ae5-4155-4ca5-9c49-d484cc10d914 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:29.071275 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881ae5-4155-4ca5-9c49-d484cc10d914 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:29.071912 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56881ae5-4155-4ca5-9c49-d484cc10d914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:29.074113 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56881ae5-4155-4ca5-9c49-d484cc10d914 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:29.083850 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1429/2868] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:58:29.089209 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27170a-7048-4845-907f-1121d0cf3df3 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:29.099714 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27170a-7048-4845-907f-1121d0cf3df3 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:29.104900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed065a-f2b3-4ef4-8931-30d65493742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:29.105549 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed065a-f2b3-4ef4-8931-30d65493742b admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:29.105819 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed065a-f2b3-4ef4-8931-30d65493742b admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:29.106087 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed065a-f2b3-4ef4-8931-30d65493742b admin admin] PATH_INFO: `/v3/projects/3c6f1588a5434d3990c97a10dcfbaddd/users/bc43aa3f9d4f4f3a99170d91555ebd89/roles/3eb3a11165ab4369b2f88a4dc9cc7d60` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:29.107992 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed065a-f2b3-4ef4-8931-30d65493742b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6f1588a5434d3990c97a10dcfbaddd, user_id=bc43aa3f9d4f4f3a99170d91555ebd89, role_id=3eb3a11165ab4369b2f88a4dc9cc7d60)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:29.110608 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed065a-f2b3-4ef4-8931-30d65493742b admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:29.121614 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1440/2869] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:58:29 2022] PUT /identity/v3/projects/3c6f1588a5434d3990c97a10dcfbaddd/users/bc43aa3f9d4f4f3a99170d91555ebd89/roles/3eb3a11165ab4369b2f88a4dc9cc7d60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:29.776764 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feed20-a734-4e71-aad3-c1a79cda2016 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:29.777289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feed20-a734-4e71-aad3-c1a79cda2016 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:29.777289 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feed20-a734-4e71-aad3-c1a79cda2016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:29.805941 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-87feed20-a734-4e71-aad3-c1a79cda2016 None None] MFA Rules not processed for user `bc43aa3f9d4f4f3a99170d91555ebd89`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:29.807673 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-87feed20-a734-4e71-aad3-c1a79cda2016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:29.883664 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1430/2870] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:29.894818 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3b81-0638-49ae-9970-cc8bd407070f None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:29.895326 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3b81-0638-49ae-9970-cc8bd407070f None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:29.895454 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3b81-0638-49ae-9970-cc8bd407070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:29.915059 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-a6bb3b81-0638-49ae-9970-cc8bd407070f None None] MFA Rules not processed for user `f387516864f949738922a55b875e3667`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:29.916338 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a6bb3b81-0638-49ae-9970-cc8bd407070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:29.977272 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1441/2871] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:58:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:29.990475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feed20-a734-4e71-aad3-c1a79cda2016 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:29.992339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-87feed20-a734-4e71-aad3-c1a79cda2016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:30.068649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feed20-a734-4e71-aad3-c1a79cda2016 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:30.074707 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b5941-df73-4596-9d26-1d908510f697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:30.075424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b5941-df73-4596-9d26-1d908510f697 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:30.075615 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b5941-df73-4596-9d26-1d908510f697 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:30.075888 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b5941-df73-4596-9d26-1d908510f697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:30.083568 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b5941-df73-4596-9d26-1d908510f697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:30.085136 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b5941-df73-4596-9d26-1d908510f697 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:30.094548 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1431/2872] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:30.663947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3b81-0638-49ae-9970-cc8bd407070f None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:30.666529 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-a6bb3b81-0638-49ae-9970-cc8bd407070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:30.747096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3b81-0638-49ae-9970-cc8bd407070f None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:30.752076 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540d77-7361-402b-984d-423985107808 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:30.752682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540d77-7361-402b-984d-423985107808 service placement] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:30.752957 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540d77-7361-402b-984d-423985107808 service placement] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:30.753224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540d77-7361-402b-984d-423985107808 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:30.754982 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-44540d77-7361-402b-984d-423985107808 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:30.767026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44540d77-7361-402b-984d-423985107808 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:30.768603 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44540d77-7361-402b-984d-423985107808 service placement] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:30.778953 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1442/2873] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:32.623690 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b5941-df73-4596-9d26-1d908510f697 service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:32.649721 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:32.680684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b5941-df73-4596-9d26-1d908510f697 service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:32.685211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:32.686361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:32.686361 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:32.686585 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:32.689211 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:32.700143 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:32.701520 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:32.709811 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1432/2874] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:36.923906 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540d77-7361-402b-984d-423985107808 service placement] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:36.938686 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540d77-7361-402b-984d-423985107808 service placement] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:36.944416 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66676c49-ff13-4e82-9a12-f6544ddbbb74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:36.945074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66676c49-ff13-4e82-9a12-f6544ddbbb74 service nova] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:36.945395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66676c49-ff13-4e82-9a12-f6544ddbbb74 service nova] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:36.945699 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66676c49-ff13-4e82-9a12-f6544ddbbb74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:36.948052 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-66676c49-ff13-4e82-9a12-f6544ddbbb74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:36.961382 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66676c49-ff13-4e82-9a12-f6544ddbbb74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:36.963793 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66676c49-ff13-4e82-9a12-f6544ddbbb74 service nova] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:36.975890 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1443/2875] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:40.585867 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:40.587301 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:40.646005 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118247e-d421-4df0-a2c8-1b8a93a1d90f service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:40.650243 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f5741-8871-469c-91c8-fc0b3d2792c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:40.651475 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f5741-8871-469c-91c8-fc0b3d2792c2 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:40.651753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f5741-8871-469c-91c8-fc0b3d2792c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:40.652018 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f5741-8871-469c-91c8-fc0b3d2792c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:40.661058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f5741-8871-469c-91c8-fc0b3d2792c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:40.662501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f5741-8871-469c-91c8-fc0b3d2792c2 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:40.672017 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1433/2876] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:46.971527 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:50.667866 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=42 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:59.256961 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66676c49-ff13-4e82-9a12-f6544ddbbb74 service nova] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:59.268846 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66676c49-ff13-4e82-9a12-f6544ddbbb74 service nova] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:59.273909 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44786b5d-fbe0-481e-879f-ea84c67de7dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:59.274511 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44786b5d-fbe0-481e-879f-ea84c67de7dc service placement] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.274808 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44786b5d-fbe0-481e-879f-ea84c67de7dc service placement] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.275100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44786b5d-fbe0-481e-879f-ea84c67de7dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.277126 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-44786b5d-fbe0-481e-879f-ea84c67de7dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:59.289386 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44786b5d-fbe0-481e-879f-ea84c67de7dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:59.291757 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44786b5d-fbe0-481e-879f-ea84c67de7dc service placement] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:59.304041 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1444/2877] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:59.316112 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f5741-8871-469c-91c8-fc0b3d2792c2 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:59.382347 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f5741-8871-469c-91c8-fc0b3d2792c2 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:59.387294 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:59.387919 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.388224 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.388493 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] PATH_INFO: `/v3/users/f387516864f949738922a55b875e3667` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.389604 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f387516864f949738922a55b875e3667)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:59.391562 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:59.439256 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f387516864f949738922a55b875e3667'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.446327 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f387516864f949738922a55b875e3667'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.454083 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f387516864f949738922a55b875e3667'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.466649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f387516864f949738922a55b875e3667'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.467341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f387516864f949738922a55b875e3667'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.473162 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1434/2878] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:58:59 2022] DELETE /identity/v3/users/f387516864f949738922a55b875e3667 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:58:59.652456 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44786b5d-fbe0-481e-879f-ea84c67de7dc service placement] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:59.663947 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44786b5d-fbe0-481e-879f-ea84c67de7dc service placement] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:59.722179 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:59.722838 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.723124 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.723398 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] PATH_INFO: `/v3/projects/d1fb25384dde4f27b43b82726ccf9319` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.724509 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1fb25384dde4f27b43b82726ccf9319)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:59.726406 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:59.773268 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1fb25384dde4f27b43b82726ccf9319', 'request_id': 'req-f5406685-443e-4039-8980-1a8b6d608592'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.779367 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1fb25384dde4f27b43b82726ccf9319', 'request_id': 'req-f5406685-443e-4039-8980-1a8b6d608592'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.787277 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1fb25384dde4f27b43b82726ccf9319', 'request_id': 'req-f5406685-443e-4039-8980-1a8b6d608592'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.799171 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] The token cache is being invalidate because project d1fb25384dde4f27b43b82726ccf9319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:58:59.799486 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.800133 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.801646 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1445/2879] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:58:59 2022] DELETE /identity/v3/projects/d1fb25384dde4f27b43b82726ccf9319 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:58:59.805680 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:59.807341 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:59.820450 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b23a27-6e98-4797-a337-3b474d95b0fc admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:59.876365 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:59.876905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.877181 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.877452 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] PATH_INFO: `/v3/users/bc43aa3f9d4f4f3a99170d91555ebd89` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.878578 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc43aa3f9d4f4f3a99170d91555ebd89)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:59.880523 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:59.903720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:59.929876 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc43aa3f9d4f4f3a99170d91555ebd89'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.936893 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc43aa3f9d4f4f3a99170d91555ebd89'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.943609 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc43aa3f9d4f4f3a99170d91555ebd89'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.956405 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc43aa3f9d4f4f3a99170d91555ebd89'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.957055 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-2dabe8c1-eca2-49d8-beca-255adaa416c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc43aa3f9d4f4f3a99170d91555ebd89'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:58:59.963527 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1435/2880] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:58:59 2022] DELETE /identity/v3/users/bc43aa3f9d4f4f3a99170d91555ebd89 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:59:00.136314 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.137768 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:00.151463 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406685-443e-4039-8980-1a8b6d608592 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.211119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.211759 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.212040 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.212309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] PATH_INFO: `/v3/projects/3c6f1588a5434d3990c97a10dcfbaddd` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.214900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6f1588a5434d3990c97a10dcfbaddd)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.217270 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.238704 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:00.266100 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6f1588a5434d3990c97a10dcfbaddd', 'request_id': 'req-de451ab3-35d0-4e42-93f4-c17db782cc4f'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:00.271541 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6f1588a5434d3990c97a10dcfbaddd', 'request_id': 'req-de451ab3-35d0-4e42-93f4-c17db782cc4f'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:00.279347 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6f1588a5434d3990c97a10dcfbaddd', 'request_id': 'req-de451ab3-35d0-4e42-93f4-c17db782cc4f'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:00.290200 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] The token cache is being invalidate because project 3c6f1588a5434d3990c97a10dcfbaddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:59:00.290482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:00.291816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-de451ab3-35d0-4e42-93f4-c17db782cc4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:00.293291 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1446/2881] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:59:00 2022] DELETE /identity/v3/projects/3c6f1588a5434d3990c97a10dcfbaddd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:59:00.298480 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca4933-6f38-49b5-9624-79ab6e19944e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.298787 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca4933-6f38-49b5-9624-79ab6e19944e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.299073 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca4933-6f38-49b5-9624-79ab6e19944e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.318637 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-18ca4933-6f38-49b5-9624-79ab6e19944e None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:00.319903 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-18ca4933-6f38-49b5-9624-79ab6e19944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:00.379482 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1436/2882] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:00.387368 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ad532-658f-4f09-90f3-ccaff71868b1 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.387652 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ad532-658f-4f09-90f3-ccaff71868b1 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.387951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ad532-658f-4f09-90f3-ccaff71868b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.407925 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-d26ad532-658f-4f09-90f3-ccaff71868b1 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:00.409117 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-d26ad532-658f-4f09-90f3-ccaff71868b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:00.417439 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1447/2883] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:59:00.421989 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca4933-6f38-49b5-9624-79ab6e19944e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.432953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca4933-6f38-49b5-9624-79ab6e19944e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.437612 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac5750-7439-49b6-abed-d56c96ee61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.438212 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac5750-7439-49b6-abed-d56c96ee61f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.438498 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac5750-7439-49b6-abed-d56c96ee61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.438801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac5750-7439-49b6-abed-d56c96ee61f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.439452 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac5750-7439-49b6-abed-d56c96ee61f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:59:00.439763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac5750-7439-49b6-abed-d56c96ee61f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.441371 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac5750-7439-49b6-abed-d56c96ee61f4 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.455832 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1437/2884] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:59:00.463739 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ad532-658f-4f09-90f3-ccaff71868b1 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.473176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ad532-658f-4f09-90f3-ccaff71868b1 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.477783 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adcedc-83c8-4126-bb70-1161248fa72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.479026 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adcedc-83c8-4126-bb70-1161248fa72c admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.479420 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adcedc-83c8-4126-bb70-1161248fa72c admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.479692 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adcedc-83c8-4126-bb70-1161248fa72c admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.480309 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adcedc-83c8-4126-bb70-1161248fa72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.482190 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adcedc-83c8-4126-bb70-1161248fa72c admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.508697 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1448/2885] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:59:00 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:59:00.513164 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac5750-7439-49b6-abed-d56c96ee61f4 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.523188 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac5750-7439-49b6-abed-d56c96ee61f4 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.581160 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399d492-20ad-4f91-bc92-b4a7a12ada03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.581775 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d492-20ad-4f91-bc92-b4a7a12ada03 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.582056 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d492-20ad-4f91-bc92-b4a7a12ada03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.582332 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d492-20ad-4f91-bc92-b4a7a12ada03 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.583009 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399d492-20ad-4f91-bc92-b4a7a12ada03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.584925 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399d492-20ad-4f91-bc92-b4a7a12ada03 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.607279 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1438/2886] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:59:00 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:59:00.611372 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adcedc-83c8-4126-bb70-1161248fa72c admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.621615 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adcedc-83c8-4126-bb70-1161248fa72c admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.626156 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862886ce-78b5-4080-8161-70d35e143164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.626746 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862886ce-78b5-4080-8161-70d35e143164 admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.627053 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862886ce-78b5-4080-8161-70d35e143164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.627320 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862886ce-78b5-4080-8161-70d35e143164 admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.627951 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862886ce-78b5-4080-8161-70d35e143164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.629572 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862886ce-78b5-4080-8161-70d35e143164 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.640194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1449/2887] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:59:00.644159 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399d492-20ad-4f91-bc92-b4a7a12ada03 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.655115 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399d492-20ad-4f91-bc92-b4a7a12ada03 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.659829 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fd820-869f-43ff-b1a1-888b95a41068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.660429 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd820-869f-43ff-b1a1-888b95a41068 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.660711 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd820-869f-43ff-b1a1-888b95a41068 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.660987 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd820-869f-43ff-b1a1-888b95a41068 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.661652 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fd820-869f-43ff-b1a1-888b95a41068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.663368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fd820-869f-43ff-b1a1-888b95a41068 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.674251 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1439/2888] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:59:00.678508 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862886ce-78b5-4080-8161-70d35e143164 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.689594 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862886ce-78b5-4080-8161-70d35e143164 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.695096 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20abd13-5de6-4392-846b-542117cf9c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.695744 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20abd13-5de6-4392-846b-542117cf9c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.696028 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20abd13-5de6-4392-846b-542117cf9c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.696300 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20abd13-5de6-4392-846b-542117cf9c73 admin admin] PATH_INFO: `/v3/projects/451a00ae3d4d4ffa8860e40337888271/users/9bb772cc24d34feaa5b3f3f1691a5d85/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.711224 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20abd13-5de6-4392-846b-542117cf9c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451a00ae3d4d4ffa8860e40337888271, user_id=9bb772cc24d34feaa5b3f3f1691a5d85, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.714045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20abd13-5de6-4392-846b-542117cf9c73 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.727178 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1450/2889] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:59:00 2022] PUT /identity/v3/projects/451a00ae3d4d4ffa8860e40337888271/users/9bb772cc24d34feaa5b3f3f1691a5d85/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:59:00.738758 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813c99a-2b6f-47cf-9de4-e6d5487d25d9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.739071 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813c99a-2b6f-47cf-9de4-e6d5487d25d9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.739349 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813c99a-2b6f-47cf-9de4-e6d5487d25d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.749177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:00.772414 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c813c99a-2b6f-47cf-9de4-e6d5487d25d9 None None] MFA Rules not processed for user `9bb772cc24d34feaa5b3f3f1691a5d85`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:00.773668 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c813c99a-2b6f-47cf-9de4-e6d5487d25d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:00.837394 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1440/2890] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:00.848684 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20abd13-5de6-4392-846b-542117cf9c73 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.850501 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-c20abd13-5de6-4392-846b-542117cf9c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:00.910084 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20abd13-5de6-4392-846b-542117cf9c73 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.913712 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1f4a0-d8e8-48bd-9606-65ee71752cfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.914317 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1f4a0-d8e8-48bd-9606-65ee71752cfe service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.914599 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1f4a0-d8e8-48bd-9606-65ee71752cfe service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.914900 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1f4a0-d8e8-48bd-9606-65ee71752cfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.924431 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1f4a0-d8e8-48bd-9606-65ee71752cfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.925870 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1f4a0-d8e8-48bd-9606-65ee71752cfe service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.935792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1451/2891] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:10.834538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=30 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:10.930688 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:12.409893 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813c99a-2b6f-47cf-9de4-e6d5487d25d9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:12.474459 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813c99a-2b6f-47cf-9de4-e6d5487d25d9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:12.479033 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:12.479670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:12.479949 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:12.480234 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] PATH_INFO: `/v3/users/9bb772cc24d34feaa5b3f3f1691a5d85` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:12.481339 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb772cc24d34feaa5b3f3f1691a5d85)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:12.483403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:12.531670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb772cc24d34feaa5b3f3f1691a5d85'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:12.538590 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb772cc24d34feaa5b3f3f1691a5d85'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:12.546934 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb772cc24d34feaa5b3f3f1691a5d85'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:12.559070 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb772cc24d34feaa5b3f3f1691a5d85'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:12.559748 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb772cc24d34feaa5b3f3f1691a5d85'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:12.566746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1441/2892] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 20:59:12 2022] DELETE /identity/v3/users/9bb772cc24d34feaa5b3f3f1691a5d85 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:59:12.571306 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d535e16-4598-49ad-b84b-6ce5c81a7e6b None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:12.571777 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d535e16-4598-49ad-b84b-6ce5c81a7e6b None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:12.571878 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d535e16-4598-49ad-b84b-6ce5c81a7e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:12.591058 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-9d535e16-4598-49ad-b84b-6ce5c81a7e6b None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:12.592279 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9d535e16-4598-49ad-b84b-6ce5c81a7e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:12.655816 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1452/2893] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:12.665738 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:12.667277 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:12.729425 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1d2c4-846a-4936-9f7c-d5561b0bebf1 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:12.733617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce502c9-5988-480f-9b87-f24822f2069a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:12.734404 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce502c9-5988-480f-9b87-f24822f2069a service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:12.734683 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce502c9-5988-480f-9b87-f24822f2069a service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:12.734981 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce502c9-5988-480f-9b87-f24822f2069a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:12.744424 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce502c9-5988-480f-9b87-f24822f2069a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:12.745868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce502c9-5988-480f-9b87-f24822f2069a service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:12.756437 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1442/2894] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:13.028792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d535e16-4598-49ad-b84b-6ce5c81a7e6b None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:13.030847 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-9d535e16-4598-49ad-b84b-6ce5c81a7e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:13.042986 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d535e16-4598-49ad-b84b-6ce5c81a7e6b None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:13.048720 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:13.049488 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.049844 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.050189 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] PATH_INFO: `/v3/projects/451a00ae3d4d4ffa8860e40337888271` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.052442 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451a00ae3d4d4ffa8860e40337888271)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:13.054412 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:13.104375 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451a00ae3d4d4ffa8860e40337888271', 'request_id': 'req-72236611-380b-4900-ab93-171f42d37d29'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:13.111108 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451a00ae3d4d4ffa8860e40337888271', 'request_id': 'req-72236611-380b-4900-ab93-171f42d37d29'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:13.118724 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451a00ae3d4d4ffa8860e40337888271', 'request_id': 'req-72236611-380b-4900-ab93-171f42d37d29'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:13.130758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] The token cache is being invalidate because project 451a00ae3d4d4ffa8860e40337888271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:59:13.131071 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:13.131706 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-72236611-380b-4900-ab93-171f42d37d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:59:13.133181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1453/2895] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 20:59:13 2022] DELETE /identity/v3/projects/451a00ae3d4d4ffa8860e40337888271 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:59:13.138495 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c1461-cb99-4f0e-ba78-dfd0b6faf7eb None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.138792 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c1461-cb99-4f0e-ba78-dfd0b6faf7eb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.139101 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c1461-cb99-4f0e-ba78-dfd0b6faf7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.159336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fb3c1461-cb99-4f0e-ba78-dfd0b6faf7eb None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:13.160451 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fb3c1461-cb99-4f0e-ba78-dfd0b6faf7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:13.178670 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:13.230184 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1443/2896] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:13.239212 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7924-567f-439b-93a2-e778dfe1b059 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.239495 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7924-567f-439b-93a2-e778dfe1b059 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.239772 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7924-567f-439b-93a2-e778dfe1b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.258853 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-fb1f7924-567f-439b-93a2-e778dfe1b059 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:13.260047 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-fb1f7924-567f-439b-93a2-e778dfe1b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:13.268513 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1454/2897] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:13.272841 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c1461-cb99-4f0e-ba78-dfd0b6faf7eb None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:13.283734 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c1461-cb99-4f0e-ba78-dfd0b6faf7eb None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:13.288753 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db9ce4-0adc-4e28-b3cb-892e7d23d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:13.289360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9ce4-0adc-4e28-b3cb-892e7d23d386 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.289633 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9ce4-0adc-4e28-b3cb-892e7d23d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.289899 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9ce4-0adc-4e28-b3cb-892e7d23d386 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.290542 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db9ce4-0adc-4e28-b3cb-892e7d23d386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:59:13.290868 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db9ce4-0adc-4e28-b3cb-892e7d23d386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:13.292591 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db9ce4-0adc-4e28-b3cb-892e7d23d386 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:13.304506 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1444/2898] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Aug 18 20:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:59:13.309095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7924-567f-439b-93a2-e778dfe1b059 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:13.318512 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7924-567f-439b-93a2-e778dfe1b059 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:13.323229 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f2a49-5b31-4aac-bd1c-084cba1aac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:13.323817 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f2a49-5b31-4aac-bd1c-084cba1aac4a admin admin] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.324095 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f2a49-5b31-4aac-bd1c-084cba1aac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.324362 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f2a49-5b31-4aac-bd1c-084cba1aac4a admin admin] PATH_INFO: `/v3/projects` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.324976 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f2a49-5b31-4aac-bd1c-084cba1aac4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:13.327392 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f2a49-5b31-4aac-bd1c-084cba1aac4a admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:13.355128 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1455/2899] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Aug 18 20:59:13 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:59:13.359360 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db9ce4-0adc-4e28-b3cb-892e7d23d386 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:13.369385 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db9ce4-0adc-4e28-b3cb-892e7d23d386 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:13.432790 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c96e4-da78-4676-8094-3a478da32528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:13.433501 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c96e4-da78-4676-8094-3a478da32528 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.433705 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c96e4-da78-4676-8094-3a478da32528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.433980 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c96e4-da78-4676-8094-3a478da32528 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.434606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c96e4-da78-4676-8094-3a478da32528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:13.437157 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c96e4-da78-4676-8094-3a478da32528 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:13.459368 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1445/2900] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Aug 18 20:59:13 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:59:13.463328 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f2a49-5b31-4aac-bd1c-084cba1aac4a admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:13.474536 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f2a49-5b31-4aac-bd1c-084cba1aac4a admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:13.479216 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76f894-a8d3-480e-abd0-e4a51ba2b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:13.479813 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f894-a8d3-480e-abd0-e4a51ba2b7ce admin admin] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.480093 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f894-a8d3-480e-abd0-e4a51ba2b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.480366 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f894-a8d3-480e-abd0-e4a51ba2b7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.481035 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76f894-a8d3-480e-abd0-e4a51ba2b7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:13.482623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76f894-a8d3-480e-abd0-e4a51ba2b7ce admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:13.492985 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1456/2901] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:59:13.496905 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c96e4-da78-4676-8094-3a478da32528 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:13.507079 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c96e4-da78-4676-8094-3a478da32528 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:13.517629 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821e1c9-96e7-498c-96ca-5ab464dc8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:13.518249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821e1c9-96e7-498c-96ca-5ab464dc8f7d admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.518538 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821e1c9-96e7-498c-96ca-5ab464dc8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.518878 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821e1c9-96e7-498c-96ca-5ab464dc8f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.519525 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821e1c9-96e7-498c-96ca-5ab464dc8f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:13.521138 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821e1c9-96e7-498c-96ca-5ab464dc8f7d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:13.532937 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1446/2902] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Aug 18 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:59:13.537256 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76f894-a8d3-480e-abd0-e4a51ba2b7ce admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:13.547443 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76f894-a8d3-480e-abd0-e4a51ba2b7ce admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:13.552101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4643-0d3e-49b5-882b-2df9dba72dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:13.552741 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4643-0d3e-49b5-882b-2df9dba72dda admin admin] REQUEST_METHOD: `PUT` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.553018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4643-0d3e-49b5-882b-2df9dba72dda admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.553288 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4643-0d3e-49b5-882b-2df9dba72dda admin admin] PATH_INFO: `/v3/projects/4aa4ace8291a43ae94e1d03a699df572/users/5cb6b05f63674b32b67089a631f098c2/roles/b7551ed385954688a565792f95efda9c` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.568696 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e4643-0d3e-49b5-882b-2df9dba72dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa4ace8291a43ae94e1d03a699df572, user_id=5cb6b05f63674b32b67089a631f098c2, role_id=b7551ed385954688a565792f95efda9c)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:13.571380 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e4643-0d3e-49b5-882b-2df9dba72dda admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:13.586526 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1457/2903] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Aug 18 20:59:13 2022] PUT /identity/v3/projects/4aa4ace8291a43ae94e1d03a699df572/users/5cb6b05f63674b32b67089a631f098c2/roles/b7551ed385954688a565792f95efda9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:59:13.591953 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671716-9f8e-4639-a467-9bc8b7b622d7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.592241 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671716-9f8e-4639-a467-9bc8b7b622d7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.593117 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671716-9f8e-4639-a467-9bc8b7b622d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.613208 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-59671716-9f8e-4639-a467-9bc8b7b622d7 None None] MFA Rules not processed for user `046ce058984843509c9c689fc1b1fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:13.614322 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-59671716-9f8e-4639-a467-9bc8b7b622d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:13.675403 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1447/2904] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:13.684975 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4643-0d3e-49b5-882b-2df9dba72dda admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:13.686749 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-256e4643-0d3e-49b5-882b-2df9dba72dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:13.710278 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:13.748086 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4643-0d3e-49b5-882b-2df9dba72dda admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:13.752506 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234612-f2cf-48e4-aa14-742e39748343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:13.753111 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234612-f2cf-48e4-aa14-742e39748343 service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:13.753395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234612-f2cf-48e4-aa14-742e39748343 service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:13.753667 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234612-f2cf-48e4-aa14-742e39748343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:13.763023 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50234612-f2cf-48e4-aa14-742e39748343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:13.765004 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50234612-f2cf-48e4-aa14-742e39748343 service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:13.774427 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1458/2905] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:14.408768 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8ff2-7542-4ecc-afad-976796975985 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:14.409058 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8ff2-7542-4ecc-afad-976796975985 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:14.409336 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8ff2-7542-4ecc-afad-976796975985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:14.438606 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6c7c8ff2-7542-4ecc-afad-976796975985 None None] MFA Rules not processed for user `5cb6b05f63674b32b67089a631f098c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:14.439869 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6c7c8ff2-7542-4ecc-afad-976796975985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:14.457853 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:14.512904 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1448/2906] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:14.524483 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234612-f2cf-48e4-aa14-742e39748343 service neutron] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:14.525981 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-50234612-f2cf-48e4-aa14-742e39748343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:14.586480 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234612-f2cf-48e4-aa14-742e39748343 service neutron] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:14.590074 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d7da-dba3-4664-81cd-623452322a56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da4ea5ad2924cf4baef5614929b7e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:14.590682 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d7da-dba3-4664-81cd-623452322a56 service cinder] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:14.591019 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d7da-dba3-4664-81cd-623452322a56 service cinder] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:14.591292 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d7da-dba3-4664-81cd-623452322a56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:14.601103 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86d7da-dba3-4664-81cd-623452322a56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:14.602542 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86d7da-dba3-4664-81cd-623452322a56 service cinder] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:14.612705 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1459/2907] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:15.992611 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216f491-12d8-461b-a989-a4b360db131b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:15.993183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216f491-12d8-461b-a989-a4b360db131b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:15.993183 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216f491-12d8-461b-a989-a4b360db131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:16.012245 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2216f491-12d8-461b-a989-a4b360db131b None None] MFA Rules not processed for user `5cb6b05f63674b32b67089a631f098c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:16.013452 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2216f491-12d8-461b-a989-a4b360db131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:16.020649 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1449/2908] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:16.260247 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d7da-dba3-4664-81cd-623452322a56 service cinder] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:16.270659 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d7da-dba3-4664-81cd-623452322a56 service cinder] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:16.274265 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20283e71-078c-4c96-a183-16fae3be00ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c571a4bd24335b8b149825bd79d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:16.274893 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20283e71-078c-4c96-a183-16fae3be00ea service neutron] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:16.275181 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20283e71-078c-4c96-a183-16fae3be00ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:16.275453 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20283e71-078c-4c96-a183-16fae3be00ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:16.277176 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-20283e71-078c-4c96-a183-16fae3be00ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:16.287792 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20283e71-078c-4c96-a183-16fae3be00ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:16.289205 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20283e71-078c-4c96-a183-16fae3be00ea service neutron] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:16.297455 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1460/2909] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:18.737492 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216f491-12d8-461b-a989-a4b360db131b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:18.739027 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2216f491-12d8-461b-a989-a4b360db131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:18.830808 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216f491-12d8-461b-a989-a4b360db131b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:18.838746 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aa2e7-dc6e-4ed2-ae9b-fe8ac37d51aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e704b8291b4934a20cdde2ef127493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:18.839617 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aa2e7-dc6e-4ed2-ae9b-fe8ac37d51aa service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:18.839909 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aa2e7-dc6e-4ed2-ae9b-fe8ac37d51aa service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:18.840187 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aa2e7-dc6e-4ed2-ae9b-fe8ac37d51aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:18.841959 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1c4aa2e7-dc6e-4ed2-ae9b-fe8ac37d51aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:18.856409 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aa2e7-dc6e-4ed2-ae9b-fe8ac37d51aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:18.858546 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aa2e7-dc6e-4ed2-ae9b-fe8ac37d51aa service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:18.870801 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1450/2910] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:59:26.293553 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=49 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:28.865696 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=56 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:28.883943 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11528eed-afec-4ec6-a707-c330d3015bd8 None None] REQUEST_METHOD: `POST` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:28.884571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11528eed-afec-4ec6-a707-c330d3015bd8 None None] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:28.884571 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11528eed-afec-4ec6-a707-c330d3015bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:28.909219 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.auth.core [None req-11528eed-afec-4ec6-a707-c330d3015bd8 None None] MFA Rules not processed for user `5cb6b05f63674b32b67089a631f098c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:28.910447 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-11528eed-afec-4ec6-a707-c330d3015bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:28.917839 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1461/2911] 10.222.0.65 () {58 vars in 958 bytes} [Thu Aug 18 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:59:38.903604 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=3 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:43.385249 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9440915-5eb0-402e-9ab5-9d7b64bcfd3c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:43.385763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9440915-5eb0-402e-9ab5-9d7b64bcfd3c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:43.385763 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9440915-5eb0-402e-9ab5-9d7b64bcfd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:43.437103 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e9440915-5eb0-402e-9ab5-9d7b64bcfd3c None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:43.438370 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e9440915-5eb0-402e-9ab5-9d7b64bcfd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:43.502252 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1451/2912] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Aug 18 20:59:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:43.557114 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11528eed-afec-4ec6-a707-c330d3015bd8 None None] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:43.559231 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-11528eed-afec-4ec6-a707-c330d3015bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:43.668159 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11528eed-afec-4ec6-a707-c330d3015bd8 None None] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:43.674006 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9874-4110-4c42-a3a4-7f2be7402388 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:43.674623 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9874-4110-4c42-a3a4-7f2be7402388 service swift] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:43.674938 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9874-4110-4c42-a3a4-7f2be7402388 service swift] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:43.675208 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9874-4110-4c42-a3a4-7f2be7402388 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:43.683640 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e9874-4110-4c42-a3a4-7f2be7402388 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:43.685253 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e9874-4110-4c42-a3a4-7f2be7402388 service swift] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:43.694489 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1462/2913] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:59:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:59:53.499253 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=40 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:53.691115 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=41 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:59.169238 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11a233-a7ef-4612-a305-6ebdab60fd37 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:59.169722 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11a233-a7ef-4612-a305-6ebdab60fd37 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:59.169823 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11a233-a7ef-4612-a305-6ebdab60fd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:59.189684 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ad11a233-a7ef-4612-a305-6ebdab60fd37 None None] MFA Rules not processed for user `18429472ab6b403ea10105bf9239ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:59.190917 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ad11a233-a7ef-4612-a305-6ebdab60fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:59.198177 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1452/2914] 10.222.0.65 () {58 vars in 967 bytes} [Thu Aug 18 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:59.210689 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9874-4110-4c42-a3a4-7f2be7402388 service swift] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:59.221596 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9874-4110-4c42-a3a4-7f2be7402388 service swift] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:59.227018 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992bb59-fb1d-479e-89ad-baf262c0e8c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7345509ac3604cf99c0e9ef232afcd09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:59.227620 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992bb59-fb1d-479e-89ad-baf262c0e8c4 service swift] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:59.227899 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992bb59-fb1d-479e-89ad-baf262c0e8c4 service swift] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:59.228173 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992bb59-fb1d-479e-89ad-baf262c0e8c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:59.236990 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992bb59-fb1d-479e-89ad-baf262c0e8c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:59.238559 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992bb59-fb1d-479e-89ad-baf262c0e8c4 service swift] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:59.246425 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1463/2915] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Aug 18 20:59:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:00:01.284125 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11a233-a7ef-4612-a305-6ebdab60fd37 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:01.285558 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ad11a233-a7ef-4612-a305-6ebdab60fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:01.355865 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992bb59-fb1d-479e-89ad-baf262c0e8c4 service swift] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:01.369482 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992bb59-fb1d-479e-89ad-baf262c0e8c4 service swift] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:01.375261 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:01.376119 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:01.376708 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:01.376837 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] PATH_INFO: `/v3/users/5cb6b05f63674b32b67089a631f098c2` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:01.377962 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb6b05f63674b32b67089a631f098c2)` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:01.379921 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:01.388939 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11a233-a7ef-4612-a305-6ebdab60fd37 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:01.394603 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5f89c-38b5-4677-b95b-538277e2cff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:01.395261 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5f89c-38b5-4677-b95b-538277e2cff6 service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:01.395540 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5f89c-38b5-4677-b95b-538277e2cff6 service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:01.395821 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5f89c-38b5-4677-b95b-538277e2cff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:01.398100 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fdf5f89c-38b5-4677-b95b-538277e2cff6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:01.410720 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5f89c-38b5-4677-b95b-538277e2cff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:01.412576 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5f89c-38b5-4677-b95b-538277e2cff6 service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:01.424076 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1453/2916] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:01.433258 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb6b05f63674b32b67089a631f098c2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.433920 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb6b05f63674b32b67089a631f098c2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.450413 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb6b05f63674b32b67089a631f098c2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.459758 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb6b05f63674b32b67089a631f098c2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.460395 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.notifications [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb6b05f63674b32b67089a631f098c2'} {{(pid=88345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.474280 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1464/2917] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Aug 18 21:00:01 2022] DELETE /identity/v3/users/5cb6b05f63674b32b67089a631f098c2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:01.644342 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5f89c-38b5-4677-b95b-538277e2cff6 service placement] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:01.656539 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5f89c-38b5-4677-b95b-538277e2cff6 service placement] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:01.720096 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046ce058984843509c9c689fc1b1fe83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0469791b573f4534aad86764e4849307', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:01.720755 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:01.721111 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:01.721388 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] PATH_INFO: `/v3/projects/4aa4ace8291a43ae94e1d03a699df572` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:01.722567 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa4ace8291a43ae94e1d03a699df572)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:01.724511 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:01.773248 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa4ace8291a43ae94e1d03a699df572', 'request_id': 'req-eede7d13-2ad1-497a-b363-b2aba2b1148c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.779442 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa4ace8291a43ae94e1d03a699df572', 'request_id': 'req-eede7d13-2ad1-497a-b363-b2aba2b1148c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.787066 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa4ace8291a43ae94e1d03a699df572', 'request_id': 'req-eede7d13-2ad1-497a-b363-b2aba2b1148c'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.797726 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] The token cache is being invalidate because project 4aa4ace8291a43ae94e1d03a699df572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:00:01.798021 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.798650 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-eede7d13-2ad1-497a-b363-b2aba2b1148c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:00:01.800171 dv-cinder-852654-2-smb devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1454/2918] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Aug 18 21:00:01 2022] DELETE /identity/v3/projects/4aa4ace8291a43ae94e1d03a699df572 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:11.470533 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:11.794602 dv-cinder-852654-2-smb devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:44.956154 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] Authenticating user token {{(pid=88345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:44.957585 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:45.028045 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0ae87-3d35-4ab2-a599-cda6e1d12708 admin admin] Validating token access rules against request {{(pid=88345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.092101 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9d842-8401-4f91-95b4-b8d9599eb583 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be696635db224e3a868957eb5b5bae0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72de7783af3347fcb7d71d07be86d2aa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.093070 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9d842-8401-4f91-95b4-b8d9599eb583 service placement] REQUEST_METHOD: `GET` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.093535 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9d842-8401-4f91-95b4-b8d9599eb583 service placement] SCRIPT_NAME: `/identity` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.093994 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9d842-8401-4f91-95b4-b8d9599eb583 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.096194 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.fernet_utils [None req-55d9d842-8401-4f91-95b4-b8d9599eb583 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:45.107779 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9d842-8401-4f91-95b4-b8d9599eb583 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.109344 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9d842-8401-4f91-95b4-b8d9599eb583 service placement] RBAC: Authorization granted {{(pid=88345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:45.119794 dv-cinder-852654-2-smb devstack@keystone.service[88345]: [pid: 88345|app: 0|req: 1465/2919] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:55.115394 dv-cinder-852654-2-smb devstack@keystone.service[88345]: DEBUG dbcounter [-] [88345] Writing DB stats keystone:SELECT=58 {{(pid=88345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}